UIIU  FILE  copy  AD  A 1  8  1256 


tfWAl-TI^3-<302l 


PROCEEDINGS  OF  THE  EIGHTEENTH 
ANNUAL  CONFERENCE  ON  MANUAL  CONTROL 


DAYTON,  OHIO 
iUIE  S  - 10,  1902 


Editor;  Frank  L.  George 


JANUARY  1903 


DTIC 


INTERIM  REPORT  -  JUNE  1981  TO  JUNE  1982 


AUG  0  2  1983 


Approved  for  public  release;  distributiort  unlimited 


FLIGHT  DYNAMICS  LABORATORY 
AIR  FORCE  WRIGHT  AERONAUTICAL  LABORATORIES 
AIR  FORCE  SYSTEMS  COMMAND  g  0 

WRIGHT- PATTERS ON  AIR  FORCE  BASE,  OHIO  45433 


1 

if 


U8 


056 


NOTICE 


Wh0n  Goverruimnt  drawin^Si  specifications ,  or  other  data  are  used  for  ary  purpose 
other  than  in  connection  tfith  a  definitely  related  Government  procurement  operation , 
the  United  States  Government  thereby  incurs  no  responsibility  nor  any  obligation 
h'hatsoevor;  and  the  fact  that  the  government  may  have  formulated,  furnished,  or  ^n 
any  supplied  the  said  drawings,  specifications ,  or  other  data,  is  not  to  be  re¬ 
garded  by  implication  or  otherwise  as  in  any  manner  licensijgg  the  holder  or  any 
other  person  or  corporation,  or  conveying  any  rights  or  permission  to  manufacture 
use,  or  sell  any  patented  invention  that  may  in  any  way  be  related  thereto. 


This  report  has  been  reviewed  by  the  Office  of  Public  Affairs  (ASD/pa)  and  is 
releasable  to  the  National  Technical  Information  Service  (NTIS) .  At  NTIS,  it  will 
be  available  to  the  general  public,  including  foreign  nations. 


This  technical  report  has  been  reviewed  and  is  approved  for  publication. 


FPANK  L.  GEORGE 


Project  Engineer, 
Control  Dynamiaa  Branch 


RONALD  0.  ANDERSON,  Chief 
Control  Dynamica  Branch 
Plight  Control  Division 


FOR  THE  COMMANDER 

CHARLES  R.  GOSS,  JR,  LT  COL,  4(SAF 
Chief,  Fligh  Control  Division 
Flight  Dyr,;,iilc8  Laboratory 


"If  your  address  has  changsd,  if  you  wish  to  bs  rsmoved  from  our  mailing  list,  or 
if  the  addresses  is  no  longer  employed  by  your  organization  please  notify  AFWAL/FIGC, 
M-PAFB,  OH  45433  to  help  us  maintein  a  current  mailing  list". 


Copies  of  this  report  should  not  be  returned  unless  return  is  required  by  security 
considerations,  contractual  obligations,  or  notice  on  a  specific  documert. 


tCCUWITY  CL**»lflCATlON  OF  This  P»08  fiw»»«  p»l«  gwl»f«iO  _  _ _ 

REPORT  DOCUMENTATION  PAGE  befoIe'completoo^form 

T.  NUmVIr  '  |i.  OOVT  ACCESSION  NO.  1.  (IMPieNT'S  CAT AUOO  NUMBER 

AFWAL-TR-83-3021  _ 


AFWAL-TR-83-3021 


S.  title  f«ldSubr/ll«)  »  type  OF  REPORT  *  PERIOD  COVERED 

Proceedings  of  the  Eighteenth  Annual  Confer-  Interim 
ence  on  Manual  Control  June  81  -  June  82 


fr  authors*; 


Frank  L.  George,  Editor 


8.  PERFORMINO  ORO.  REPORT  NUMBER 


CONTRACT  OR  ORANT  NUMBER^*) 


4.  PERCfillMINO  OBOANIIATION.N^E  AMO  AOORM5  . 

Flight  Pynamlcs  Laboratory  (HGC) 

AF  Wri ght  Aeronautical  Laboratories 
W-P  AFB,  Ohio  45433 

11.  CONTROLLING  OFFICE  NAME  ANO  AOORESS 

Flight  Pynamics  Laboratory  (FIGC) 

AF  Wright  Aeronautical  Laboratories 
W-P  AFB  OHIO  45433  _ _ 


1^  RROORAM  CLCMeNT.  RROJeCT.  TASK 
AREA  A  WORK  UNIT  NUMSBRS 

62201F 

999135RX 

12.  report  DATE 

January  1983 

o.  number  OF  PAGES 

556 


MONITORING  AOC^Y^  NAME  A  AuORCSSi'//  /rooi  CoAffolflAj  Oitif)  SECURITY  CLASS.  ('©/ 

UNCLASSIFIED 


1S«  OeCLASSlFlCATtON/OOWNORAOlNO 
schedule 


U.  OlSTRlSUtlON  statement  (oi  Rmpori) 

Approved  for  Public  Release;  Distribution  Unlimited 


flV.  CMSTRlSuTlON  statement  (o1  iw  SfoeA  20,  U  Otttpffkt  ffpoi  H^pett) 


1 16.  supplementary  notes 


b  f'\c  'As 


IS.  KEY  WORDS  ('Conf/nu#  on  rmvf  0ld9  If  AO<«««Arr  Id0ntffy  by  block  ntmbmr) 

Human  Dynamics  Attention  Allocation 

Human  Modeling  Simulation 

Human-machine  System  Control  Manipulators 

Manual  Con'rol  Displays 

Decision  Making _ Workload _ 

20.  ADSTRACT  (C  lfaIMu*  on  rovofoo  II  n#c###AO'  •nrf  idonUly  by  AlocA  nutnbot) 

This  volume  contains  proceedings  of  the  Eighteenth  Annual  Conference 
on  Manual  Control,  held  at  Dayton,  Ohio,  June  8-10,  1982.  Forty-three 
of  the  f.irty-five 'Conference  papersj>are  repre8ented>either  as  abstracts 
or  complete  manuscripts.  Topics  covered.human  operator  modeling  from 
both  performance  and  physiological  viewpoints,  measures  of  operator 
workload  and  performance,  and  applicati^s  of  models  for  analysis  alone 
or  in  conjunction  with  simulation.  Applications  areas^jMeTude^^ontrol 


OD  1473. 


EDITION  OF  I  NOV  SB  It  ODSOLETE 


UNCLASSIFIED _ 

»EcirmT7‘cUA$iiF7cvrioiro7TH7rPAoF7i»jiIirD3r7^(,.«d) 


_ UNCLASSIFIED _ 

tfCuWiTY  CtAMiriOTtON  or  THIS  P*OE(TWnn  O—m  Kitltr*4)  , 

>and  controller  desiyn,  analysis  and  definition  of  display 

requirements,  and  integration  of  control  and  display  considerations. 

't 


UNCLASSIFIED 


CONFERENCE  CHAIRMAN 


Fremk  L.  George 

Air  Force  Wright  Aeronautical  LeQss 


AIR  FORCE  HOST: 

Ronald  0.  Anderson 

Ai;.  Force  Wright  Aeronautical  Labs 


FOREWORD 


This  volume,  published  with  the  support  of  the  Air  Force  Wright 
Aeronautical  Laboratories*  contains  the  proceedings  of  the  Eighteenth 
Amval  Conference  on  Manual  Control  held  at  the  Daytonian  Hotel,  Dayton, 
Ohio  from  June  eighth  through  tenth,  1982.  All  papers  accepted  for  the 
Meeting  are  represented  In  this  volume.  In  a  few  cases  authors  were 
unable  to  attend  and  present  accepted  papers,  or  authors  who  presented 
papers  failed  to  provide  manuscripts  for  the  proceedings.  Those  cases 
are  noted  In  the  Table  of  Contents.  Both  formal  papers,  generally 
representing  completed  work,  and  informal  papers  which  might  represent 
work  in  progress  were  presented. 

"This  was  the  eighteenth  In  a  series  of  Conferences  dating  back  to 
December  1964.  These  earlier  meetings  and  their  proceedings  are  listed 
below: 

First  Annual  NASA- Uni  vers  Ity  Conference  on  Manual  Control,  The 
University  of  Michigan,  December  1964.  (Proceedings  not  printed.) 

Second  Annual  NASA-Uni  vers  ity  Conference  on  Manual  Control, 
Massachusetts  Institute  of  Technology,  February  28  to  March  2,  1966, 
NASA-SP-128. 

Third'Annual  NASA-Uni  vers  ity  Conference  on  Manual  Control,  Univer¬ 
sity  of  Southern  California,  March  1  through  3,  1967,  NASA-SP-144. 

Fourth  Annual  NASA-Uni  vers  Ity  Conference  on  Manual  Control,  The 
University  of  Michigan,  March  21  through  23,  1968,  NASA-SP-192. 

Fifth  Annual  NASA-Uni versity  Conference  on  Manual  Control, 
Massachusetts  Institute  of  Technology,  March  27  through  29,  1969, 
NASA-SP-215. 

Sixth  Annual  Conference  on  Manual  Control,  Wright- Patterson  AFB, 

Ohio,  April  7  through  9,  1970,  proceedings  published  as  AFIT/AFFDL 
Report,  no  nunter. 

Seventh  Annual  Conference  on  Manual  Control,  University  of 
Southern  California,  June  2  through  4,  1971,  NASA-SP-281. 

Eighth  Annual  Conference  on  Manual  Control,  The  University  of 
Michigan,  May  17  through  19,  1972,  AFFDL-TR- 72-92. 

Ninth  Annual  Conference  on  Manual  Control,  Massachusetts  Institute 
of  Technology,  May  23  through  25,  1973,  proceedings  published  by  MIT, 
no  number. 

Tenth  Annual  Conference  on  Manual  Control,  Wright-Patterson  AFB,  Ohio, 
April  9  through  11,  1974,  AFIT/AFFDL  Report,  no  number. 


Eleventh  Annual  Conference  on  Manual  Control,  NASA  Ames  Research 
Center,  May  21  through  23,  1975,  NASA  TM  X-62,464. 

Twelfth  Annual  Conference  on  Manual  Control,  University  of  Illinois, 
May  25  through  27,  1976,  NASA  TM  X- 73, 170. 

Thirteenth  Annual  Conference  on  Manual  Control,  Massachusetts 
Institute  of  Technology,  June  15  through  17,  1977,  proceedings  published 
by  MIT,  no  nunter. 

Fourteenth  Annual  Conference  on  Manual  Control,  University  of 
Southern  California,  April  25  through  27,  1978,  NASA  CP-2060. 

Fifteenth  Annual  Conference  on  Manual  Control,  Wright  State 
University,  March  20  through  22,  1979,  AFFDL-TR- 79-3134. 

Sixteenth  Annual  Conference  on  Manual  Control,  Massachusetts 
Institute  of  Technology,  May  5  through  7,  1980,  proceedings  published 
by  MIT,  no  nunter. 

Seventeenth  Annual  Conference  on  Manual  Control,  University  of 
CalifOk*nia  at  Los  Angeles,  June  16  through  18,  1981,  JPL  Publ .  81-95. 

The  topic  "human-machine  system  design  methodology",  both  development 
and  applications,  received  special  emphasis  at  the  Eighteenth  Conference 
meeting. 


Frank  L.  George, 

Air  Force  Wright  Aeronautical  Labs 


CONTENTS 


PAGE 


FOREWORD . 1i1 

SESSION  1.  HUMAN  OPE. RATQR  MODELS 

Moderator:  David  L.  Kleintnan,  Unlv  of  Connecticut  ...  1 

1.  AN  INFORMATION  THEORETIC  MODEL  OF  THE  HUMAN  OPERATOR  (FORMAL) 

Charles  P.  Hatsell,  Patricia  R.  Mineer  .  3 

2.  RISK  AND  DECISION  PROCESSES  IN  MANUAL  CONTROL  BEH_AVIOR 

Tom  Btfsser  .....  .' .  5 

3.  TIME  DOMAIN  IDENTIFICATION  OF  PILOT  DINAMICS  AND  CONTROL 

STRATEGY  (FORMAL)  David  K.  Schmidt  .  19 

4.  A  TEST  OF  FITTS  •  LAW  IN  TWO  DIMENSIONS  WITH  HAND  AND  HEAD 
MOVEMENTS  (INFORMAL)  Richard  J.  Jagacinski,  Don  L.  Monk 

(Abstract  Only)  .  41 


5.  A  NONLINEAR  INTERNAL  FEEDBACK  MODEL  FOR  THE  PUPIL  CONTROL 
SYSTEM  (FORMAL)  Fuchuan  Sun,  William  C.  Kre.iz,  Lawrence  W. 

Stark  (Paper  Accepted  but  Not  Presented)  . .  .  42 

6.  COMPUTATIONAL  PROBLEMS  IN  HUMAN  OPERATOR  ARMA  MODELS 

(INFORMAL)  G|yan  C.  Agarwal ,  Hitoshi  Miura,  Gerald  L. 

Gottlieb  .  58 

SESSION  2.  PHYSIOLOGICAL  MEASURES;  WORKLOAD  AND  PERFORMANCE 

ME/gURE$  Moderator:  Ronald  0.  Anderson,  Air  Force 

Wrfght  Aeronautical  Laboratories  .  75 

1.  CHANGES  IN  HUMAN  JOINT  COMPLIANCE  DURING  PERIPHERAL  ISCHEMIA 
(FORMAL)  Robert  J.  Jaeger,  Gyan  C.  Agarwal,  Gerald  L.  Gottlieb  77 

2.  DECISION  MAKING  AND  THE  STEADY  STATE  VISUALLY  EVOKED  EEG 

(INFORMAL)  Andrew  M.  Junker,  Glen  F.  Wilson  ......  99 


3.  OPERATOR  WORKLOAD  AS  A  FUNCTION  OF  THE  SYSTEM  STATE:  AN 
ANALYSIS  BASED  UPON  THE  EVENT-RELATED  BRAIN  POTENTIAL 
(INFORMAL)  Richard  T.  Gill,  Christopher  Wickens  (Paper 

Accepted  but  Not  Presented)  .  100 

4.  ASSESSMENT  OF  MANUAL^  PROCESS  CONTROL  STRATEGIES  (INFORMAL) 

Joseph  C.  DeMaio  . . . 108 


5.  DEVELOPMENT  OF  PERFORMANCE  MEASURES  FOR  SELECTION  OF  CREWS 
FOR  FLIGHT  TRAINING  (FORMAL)  Eckvard  M.  Connelly  (Paper 
Not  Available)  . 


V 


CONTENTS  (Conf  d) 


PAGE 

6.  A  Fuzzy  MODEL  OF  RATHEF  UEAVY  WORKLOAD  (FORMAL)  Neville 

Moray,  K.  Waterton  .  120 

7.  RATim  CONSISTERCy  AND  COMPONENT  SALIENCE  IN  SUBJECTIVE 
WORKLOAD  ESTIMATION  (FORMAL)  Jan  R.  Hauser,  Mary  E.  Childress, 

Sandra  G.  Hart  .  127 

8.  THE  SENSITIVITY  OF  TWENTY  MEASURES  OF  PILOT  MENTAL  WORKLOAD 
_  .IN  A  SIMULATED. ILS  TASK  (FORMAL)  W.  W.  Wierv/llle,  Sidney  A. 

Oonnor  (Paper  Accr^nted  But  Not  Presented)  .  150 

SESSION  3.  SIMULATION  AND  MODEL  BASED  ANALYSIS  Moderator:  Andrew 

M.  Junker,  Air  Force  Aerospace  Medical  Research  Lab  .  163 

1.  DEVELOPMENT  OF  A  G-SEaT  ROLL- AXIS  DRIVE  ALGORITHM  (INFORMAL) 

Edward  A.  Martin,  Grant  R.  McMillan  (Abstract  Only)  ...  165 

2.  COMPENSATION  FOR  TIME  DELAYS  IN  FLIGHT  SIMULATOR  VISUAL 

DISPLAY  SYSTEMS  (INFORMAL)  0.  Francis  Crane  (Abstract  Only)  .  166 

3.  AN  AUTOMOBILE  AND  SIMULATOR  COMPARISON  OF  DRIVER  BEHAVIOR 
IN  A  COLLISION  AVOIDANCE  MANOEUVRE  (INFORMAL)  EHc  N. 

Solowka,  Lloyd  D.  Reid  .  168 

4.  AN  OPTIMAL  CONTROL  MODEL  ANALYSIS  OF  DATA  FROM  A  SIMULATED 

HOVER  TASK  (FORMAL)  Sheldon  Baron  .  186 

5 .  ANALYSIS  OF  A  AAA  SUPERVISORY  CONTROL  TASK  USING  SAINT 
(INFORMAL)  Kuang  C.  Wei,  Blaza  Toman,  Joseph  Whitmeyer, 

Sharon  L.  Ward .  207 

6 .  HUMAN  RESPONSE  MODELING  AND  FIELD  TEST  VALIDATION  OF  AN  AIR 
DESENSE  GUN  SYSTEM  SIMULATION  (FORMAL)  Y.  K.  Yin,  K.  Sahara, 

V.  Dea,  A.  Netch  .  225 

7.  EFFECTS  OF  PRACTICE  ON  PILOT  RESPONSE  BEHAVIOR  (INFORMAL) 

William  H.  Levi  son  .  239 

8.  A  MODERN  APPROACH  TO  PILOT-VEHICLE  ANALYSIS  AND  THE  NEAL- 

SMITH  CRITERIA  (FORMAL)  B.  J.  Bacon,  David  K.  Schmidt  ...  256 

9.  A  STRUCTURED  METHODOLOGY  FOR  ANALYZING  HUMAN  INFORMATION 
PROCESSING  IN  COMMAND  SYSTEMS  (FORMAL)  Joseph  G.  Wohl , 

Krishna  R.  Pattipati,  David  L.  Kleinman,  Nils  R.  Sandell  Jr., 

Elliot  E.  Entin  (Abstract  Only)  .  263 


CONTENTS  (Cont'd) 


PAGE 


SESSION  4.  MODEL  BASED  DESIGN  AND  CONTROL  INTEGRATION 

Moderator:  Sheldon  Baron,  Bolt,  Beranek  and  Newman,  Inc.  265 

1.  VISUAL  CUB  REQUIREMENTS  FOR  FLIGHT  CONTROL  TASKS  (FORMAL) 

Ronald  A,  Hess,  Arthur  Beckman  (Abstract  only)  .  267 

2.  VALIDATION  OF  AN  ADVANCED  COCKPIT  DISPLAY  DESIGN  METHODOLOGY 
VIA  WORKLOAD/MONITORING  TRADEOFF  ANALYSIS  (INFORMAL)  Johnathan 


Kom,  Sol  W.  Gully,  David  L.  Kleinman  . 268 

3.  HUMAN-MACHINE  INTERFACE  ISSUES  IN  THE  DESIGN  OF  INCREASINGLY 

AUTCmTED  NASA  CONTROL  ROOMS  (INFORMAL)  Christine  M.  Mitchell  293 


4.  KEYBOARD  DESIGN  VARIABLES  IN  DUAL-TASK  MODE  SELECTION  (FORMAL) 

Mark  D.  Hansen  (Paper  accepted,  not  presented)  . 320 

5.  AN  ANALYSIS  OF  CONTROL  RESPONSES  AS  A  FUNCTION  OF  DISPLAY 

DYNAMICS  IN  PERSPECTIVE  AIRCRAFT  DISPLAYS  WITH  PREDICTION 
(INFORMAL)  Jeffrey  L.  Maresh,  Richard  S.  Jensen  .  327 

6.  INSTRUMENT  POSITION-CONTROL  MANIPULATION  (IPCOM  II):  HELICOPTER 

PILOT  RESPONSES  AS  A  FUNCTION  OF  CONTROL- DISPLAY  COMPATIBILITY 
(INFORMAL)  Kathleen  M.  Craig  .  336 

7.  HELICOPTER  PILOT  RESPONSE  LATENCY  AS  A  FUNCTION  OF  THE  SPATIAL 

ARRANGEMENT  OF  INSTRUMENTS  AND  CONTROLS  (FORMAL)  E.  James 
Hartzell,  S.  Dunbar,  R.  Beveridge,  R.  Cortilla . 345 

8.  CONTROLS,  DISPLAYS  AND  SITUATION  AWARENESS  ON  THE  FINAL  APPROACH 

(FORMAL)  Lee  H.  Person,  Jr.  (Abstract  only) . 365 


9.  CHARATERISTICS  OF  A  COMPENSATORY  MANUAL  CONTROL  SYSTEM  WITH 
ELECTROCUTANEOUS  FEEDBACK  (FORMAL)  KazuO  Tanie,  Susumu  Tachi , 

Kiyoshi  Komoriya,  Hideo  Iguchi,  Masao  Takabe,  Minoru  Abe, 

Yoshihiro  Sakai . 366 

SESSION  5;  HUMAN-MACHINE  SYSTEMS  AND  CONTROLS  Moderator:  Ronald 

A.  Hess,  NASA  .4mes  Research  Center  . 387 

1.  A  TRANSFORM  APPROACH  TO  COLLISION  FREE  PROGRAMMING  OF 

MULTIDEGREE-OF- FREEDOM  STRUCTURES  (FOmAL)  John  G.  Kreifeldt, 

Stephen  H.  Levine  . 389 


2.  CROSS  MODALITY  SCALING:  MASS  AND  MASS  MOMENT  OF  INERTIA  (INFORMAL) 

Margaret  M.  Clark,  Stephen  Handel,  John  G.  Kreifeldt  ....  413 

3.  PROMAN:  PROGRAM  FOR  MANAGEMENT  AND  ANALYSIS  OF  MANUAL  CONTROL 
E}CPERIMENTAL  DATA  (FORMAL)  Ramal  Mural i da ren,  William  H. 

Levison  (Abstract  only) . 419 


vii 


CONTENTS  (Concluded) 


PAGE 


4.  DEXTEROUS  MANIPULATOR  LABORATORY  PROGRAM  (INFORMAL)  Roy  E. 

Olsen  .  420 

5.  STICK  CONTROLLER  DESIGN  FOR  LATERAL  ACCELERATION  ENVIRONMENTS 
(FORMAL)  D.  W.  Repperger,  W.  H.  Levison,  V.  Skowronski ,  B. 

O' Lear,  J.  W.  Frazier,  K.  E.  Hudson  .  427 

FORCE-TO^U^CONWOL  EXPERIMB^S  WITH_THE_SIMULATED  SPACE  _  _  . 

SHUfTLE~ MANIPULATOR  IN  MANUAL  CONTROu  MODE  (INFOmAL)  R.  S. 

Dotson,  A.  K.  Bejc^y,  J.  W.  Prown,  J.  L.  Lewis .  440 

7.  HELICOPTER  INTEGRATED  CONTROLLER  RESEARCH  (INFORMAL)  Sherry 

L.  Dunbar  . . 466 

8.  TENTATIVE  CRITERIA  FOR  CONTROLLERS  OF  UNCOUPLED  AIRCRAFT 

MOTION  (INFORMAL)  John  M.  Evans,  Kevin  Citurs  (Paper  not 
available) .  474 

9.  APPLICATION  OF  SPEECH  SYNTHESIS  TECHNOLOGY  TO  STINGER  MISSILE 

SYSTEM  (FORMAL)  M.  J.  CHsp,  Y.  K.  Yin,  L.  R.  Perkin  ...  475 

SESSION  6:  DISPLAY  FACTOR  Moderator:  Terry  J.  Emerson,  Air 

Force  Wright  Aeronautical  Laboratories  .  483 

1.  FACTORS  AFFECTING  IN-TRAIL  FOLLOWING  USING  CDTI  (FORMAL) 

James  R.  Kelly,  David  H.  Williams .  485 

2.  A  PERSPECTIVE  DIMENSIONAL  DISPLAY  OF  AIR  TRAFFIC  FOR 

THE  COCKPIT  (INFORMAL)  Michael  W.  McGreevy  .  514 

3.  EFFECT  OF  VFR  AIRCRAFT  JN  APPROACH  TRAFFIC  WITH  AND  WITHOUT 
COCKPIT  DISPLAYS  OF  TRAFFIC  INFORMATION  (FORMAL)  Sandra  G. 

Hart .  522 

4.  AIR  TRAFFIC  CONTROL  OF  SIMULATED  AIRCRAFT  WITH  AND  WITHOUT 
COCKPIT  TRAFFIC  DISPLAYS  (FORMAL)  Sheryl  L.  Chappell,  John 

6.  Krelfeldt .  545 

LIST  OF  AUTHORS  .  553 


AN  INFORMATION  THEORETIC  MODEL  OF  THE  HUMAN  OPERATOR 


Charles  P.  Hatsell,  Lt  Col,  USAF,  MC* 

Air  Force  Aerospace  Medical  Research  Laboratory 
Human  Engineering  Division 
Wright-Patterson  AFB  OH 

Patricia  R.  Mineer* 

ABSTRACT 

Application  of  information  theory  to  the  summing  node  in  the  manned 
system  control  loop  reveals  that  the  human  controller  must  process  two 
quantities  of  information  flow,  transinformation  I(X;Z)  due  to  dependent 
input,  X,  and  system  state  variables,  Z;  and  transinformation  I(E;Z)  due 
to  dependent  summing  node  output,  E,  and  system  state,  Z.  The  measure  of 
controller  effectiveness  is  the  entropy  decrement,  H  =  H(X)-H(E),  due  to 
loop  closure.  An  analysis  of  the  summing  node  gives, 

I(X;Z)  -  I(E;Z)  -  H  .  (1) 

It  is  argued  that  for  a  highly  motivated  human  operator  whose 
performance  on  the  subject  task  nas  plateaued,  a  task<dependent  channel 
capacity,  Ch,  will  be  totally  allocated  to  I(X;Z)  and  I(E;Z),  i.e., 

I(X;Z)  +  I(E;Z)  »  Cz  (2) 

Equations  (1)  and  (2)  comprise  the  information  theoretic  human  operator 
model . 

Model  validation  was  accomplished  on  data  from  seven  subjects  perform¬ 
ing  a  simple  one-dimensional,  purely  compensatory,  tracking  task.  The 
perturbing  function  was  a  0.5  hz  Gaussian  random  process  and  two  plants  were 
tracked,  1/s  and  l/s(s+a).  Agreement  with  the  information  theoretic  model 


*This  work  was  performed  while  the  authors  were  with  the  Crew  Technology 
Division,  School  of  Aerospace  Medicine,  Brooks  AFB  TX. 
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was  excellent  over  all  subjects  and  plants.  Performance  in  terms  of 
AH  had  high  Intersubject  variability,  reflecting  differing  I(E;Z)  among 
subjects;  furthermore,  channel  capacity  for  the  tracking  task  was  invariant 
over  subjects  and  plants.  The  l/s{s+a)  plant  was  subjectively  more  difficult 
to  control  and  always  resulted  in  a  higher  I(E;Z). 

The  information-theoretic  human  operator  model  is  valid  regardless 
of  system  linearity,  stationarlty,  or  noise  structure.  The  model  is 
simply  an  information-theoretic  statement  of  the  summing  node  together 
withj^  •''perimentally  verified  conjecture  about  how  the  human  operator 
handles  information.  Additional  experiments  should  identify  relationships 
among  Ch  ,  task-type,  and  exogenous  stressors,  with  obvious  application  to 
workload  quantification. 
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/Manual  control  behaviour  with  jT^RMS-error-criterion  is  considered  a 
good  approximation  _to  control  behaviour  with  similar  symmetric  error¬ 
weighting-functions,  but  not  asymmetric  ones.  In  order  to  test  this,  a 
compensatory  tracking  task  with  a  second  error  condition  is  defined. 
Several  experiments  shuw  that  nonlinear  (asymmetric)  tracking-behaviour 
arises  under  these  conditions.  The  adaptation  of  the  control-behaviour  to 
the  payoff-conditions  can  be  considered  an  instance  of  decision-making  on 
the  basis  of  an  expected-utility  model. 


INTRODUCTION 


The  'describing-function '-approach  to  manual  control  behaviour  does 
not  neccessarily  require  the  quantification  of  the  error  according  to  an 
RMS-error-criterion  (where  the  error  is  the  sum  of  squares  of  the  devia¬ 
tion  of  the  system-output  from  target).  However,  the  statistical  methodo¬ 
logy  available  (system  identification  with  stochastic  test-signals)  would 
make  it  rather  difficult  to  use  a  different  criterion  to  describe 
performance  of  human  subjects  in  manual  control  behaviour.  Training  in 
tracking-tasks  is  usually  based  on  this  error-criterion,  and  therefore 
subjects  adapt  to  this  property  of  the  task.  Experimental  results  can 
only  be  generalized  to  real  tasks,  when  these  have  the  same  task-struc¬ 
ture,  and  therefore  the  same  laws  may  be  assumed  to  govern  behaviour 
under  these  conditions.  It  has  been  suggested  that  this  may  not  be  the 
case  for  some  tasks,  e.g,  distance-control  in  driving  a  car  (BDSSER 
1980). 


The  basic  rationale  behind  the  use  of  the  RMS-error-criterion  is 
that  in  most  conceivable  situations  a  larger  deviation  from  the  target  is 
given  an  unproportionally  larger  weight  than  a  smaller  deviation,  and  th€ 
direction  of  the  deviation  does  not  matter.  This  view  implies  that  the 
deviation  of  system-state  from  the  set-point  or  target  is  weighted 
according  to  the  utility  (gain  or  loss)  associated  with  this  deviation. 

In  Fig.  1  this  is  shown  together  with  other  conceivable  error-criteria. 

An  error  weighted  proportional  to  the  deviation  from  the  target  may  well 
arise  e.g,  in  process-control,  where  a  deviation  from  target  may  simply 
mean  a  loss  of  material  proportional  to  this  deviation.  A  discrete  type 
of  error-criterion  is  the  fixed-limit  criterion,  where  only  the  trans- 
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Dev  iat  i  on  from  t  arget  value 


Pig.l:  Error-weighting  functions 


gression  of  a  borderline  matters,  and  weight  given  to  the  error  is  0 
within  limits,  constant  outside  of  limits. 

As  can  be  seen  from  Fig. I,  an  RMS-error-criterion  does  not  deviate 
too  much  from  a  constant-weight-criterion  or  from  a  fixed-limit-criteri¬ 
on.  Because  human  response  is  comparatively  slow  in  most  situations,  it 
is  difficult  to  respond  like  a  perfect  relay-type  controller,  this  would 
give  rise  to  a  strategy  where  the  human  controller  anticipates  approaches 
to  the  borderline  and  infers  a  value  (probability  of  beelng  driven  across 
the  limits)  which  may  be  called  'danger',  and  which  mil  give  rise  to 
compensatory  action.  The  subjective  weight  given  to  these  deviations  from 
target,  and  the  associated  tendency  to  compensate  this  error  may  corres¬ 
pond  closely  to  the  RMS-type  error-criterion. 

These  considerations  suggest  that  the  RMS-error-criterion  is  a 
reasonable  approximation  to  various  symmetric  types  of  weighting-func¬ 
tions  for  error  in  manual  contrul  situations.  It  is  quite  obvious, 
however,  that  this  does  not  apply  to  asymmetric  weighting  functions  for 
deviations  from  the  target  value,  like  the  fixed  limit  in  one  direction 
shown  in  Fig.  1.  There  are  obvious  examples  for  weighting  functions  of 
this  type:  Distance  control  in  driving  an  automobile,  where  only  ap¬ 
proach,  but  not  increasing  distance  from  a  leading  car  may  have  grave 
consequences,  operation  of  machines  of  various  kinds  or  the  drill  of  the 
dentist  have  consequences,  where  transgression  of  a  borderline,  but  not 
staying  short  of  the  line,  has  unproportionally  large  negative  weight. 
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In  order  to  investigate  manual  control  behaviour  in  tasks  with 
asymmetric  weighting-function,  a  standard  compensatory  tracking  task  was 
augmented  with  a  second  error-condition  represented  by  a  borderline  on 
the  display  (Fig. 2).  Crossing  of  the  line  is  signalled  by  a  buzzer. 

Subjects  were  required,  in  additon  to  keeping  the  error-marker  close  to 
the  target,  not  to  cross  the  borderline. 

Previous  experiments  have  shown  that  subjects  have  a  strategy 
available  to  deal  with  this  task,  which  involves  two  aspects:  Performance 
in  relation  to  the  line-criterion  is  improved  by  moving  the  mean  of  the 
control -position  away  from  the  border-line,  thus  generating  a  larger 
RMS-error.  (BOSSER  1982).  Secon^tHy  _the  tracking,  behaviour,  may  be  made  - 
more  “efficient  in  this  task  by  giving  it -a  dynamic  asymmetry,  which 
becomes  larger  with  higher  frequency  of  the  track  and  with  shorter 
distance  d  of  the  borderline.  It  was  shown  that  subjects  adapt  these 
properties  of  their  tracking  behaviour  in  a  systematic  fashion  depending 
on  the  experimental  conditions. 

Here  several  experiments  are  reported  where  the  principles  of  the 
adaptntion  of  the  human  operator  in  the  tracking  task  with  additional 
error-criterion  are  investigated.  The  adaptation  described  by  McRUER  8 
KRENDEL  (1974)  in  their  'Successive  Organization  of  Perception '-Model 
relates  to  learning  processes,  whereas  the  weighting  of  error-conditions 
or  payoff-conditions  belongs  to  the  domain  of  motivation. 

METHOD 

A  standard  compensatory  tracking-task  was  used,  augmented  by  the 
borderline  at  distance  d  from  the  target.  The  disturbance  (input-signal) 
was  derived  from  a  50Hz  3-level  Pseudo-Random-ternary  signal  (period  40. 
secs),  which  was  choosen  because  of  the  known  superior  statistical  prop¬ 
erties  for  the  identification  of  nonlinear  transfer-characteristics.  The 
original  signal  was  filtered  with  a  zero-phaseshift  filter  with  various 
cutoff-frequencies.  By  addition  of  a  number  of  these  filtered  input 
signals  with  equal  variance  were  generated  with  good  properties  for  the 
identification  procedure  used  and  which  tested  the  subjects  behaviour  in 
a  useful  range.  The  spectra  of  the  easiest  and  the  most  difficult  signal 
are  shown  in  Fig. 3 

A  zero-order  (position-)  control-system  with  isotonic  control-lever 
and  a  15  by  24  cm  oscilloscope-display  was  used,  all  control  and  data- 
rollection  was  done  on-line  by  computer. 

The  data  were  analyzed  by  calculating  statistical  parameters  of  the 
measured  signals  and  by  calculating  the  transfer-characteristics  by 
FFT-methods.  Nonlinear  transfer-characteristics  were  investigated  by 
calculating  appropriate  statistical  parameters  derived  from  WIENERs 
(1956)  theory  of  nonlinear  systems-identification.  For  a  satisfactory 
estimation  of  parameters  the  amount  of  data  available  was  rather  small, 
consequently  the  estimates  of  the  kernels  are  subject  to  much  statistical 
variation.  The  cross-covariance  calculated  in  the  time-domain  was  judged 
to  be  most  illustrative  under  these  conditions  and  is  presented  here  for 
various  conditions. 


EXPERIMENT  I 


An  asytniDQtry  in  manual  control  behaviour  may  be  caused  by  proper 
of  the  motor-system  rather  than  higher-level  control.  In  order  to  test 
this,  the  position  of  the  borderline  d  was  varied  (above  and  below 
target),  the  orientation  of  control  and  display,  and  the  frequency-compo¬ 
sition  of  the  input-signal  (break-frequency  0.57  Hz  and  0.14  Hz).  Five 
subjects  (psychology-students)  participated.  They  were  paid  for 
participation  in  the  experiment  and  were  instructed  to  give  equal  w^ 
to  both  error-conditions  (deviation  from  target  and  crossing  of  the  ; 
borderline).  After  several  hours  of  training  the  experimental  sessiofife  ; 
307“secs~ea"ch  were”'presented  in  random  order.  . 

Table  1  and  2  show  the  constant  position  error  generated  by  tht 
subjects,  one  part  of  the  strategy  subjects  follow  to  prevent  crossing 
the  borderline.  Correspondingly  the  RMS-error  rises,  and  the  number  an 
duration  of  crossings  of  the  borderline  decrease.  All  subjects  exhibit 
the  same  pattern  of  dependence  of  the  performance-variables  on  experimen 
tal  conditions.  These  results  show  clearly  that  the  constant  bias  depends 
mainly  on  the  position  of  the  borderline  above  or  below  target.  A  higher 
frequency  of  the  disturbance  -  the  consequence  of  which  is  a  higher 
probability  of  crossing  the  line  -  induces  a  larger  bias.  Reversal  of  the 
orientation  of  control-lever  and  display  does  not  show  a  considerable 
influence,  although  most  variables  (some  not  shown  here)  seem  to  suggest 
that  a  compatible  arrangement  with  borderline  below  target  gives  best 
performance. 

The  distributions  of  the  error  (Fig.  4)  demonstrate  the  same 
relationship,  the  distributions  exhibit  a  marked  asymmetry.  The  distribu¬ 
tions  of  the  speed  of  the  control-lever  indicate  the  subjects  strategy 
concerning  the  dynamics  of  the  control-behaviour:  The  highest  speeds  of 
the  control-lever  movement  occur  in  movements  away  from  the  borderline. 

For  three  conditions  (borderline  above  and  below  target  and  no 
borderline)  the  bi-crosscovariances  between  input-signal  and  remnant 
(linear  proportion  of  the  output  variance  subtracted)  are  sliown  (Fig. 5) 
and  demonstrate  that  the  nonlinear  proportion  of  tracking  behaviour  is 
dependent  on  the  experimental  conditions.  The  bi-crosscovariance  (a) 
represents  behaviour  with  the  same  input-signal  as  (b)  and  (c),  but 
without  additional  error-condition  (no  borderline).  The  much  higher 
variance  due  to  introduction  of  the  line-error-condition  is  evidence  of 
the  fact  that  subjects  are  able  to  adjust  their  control-strategy  such  as 
to  include  a  specific  nonlinear  control  strategy  (asymmetric  dynamics) 
which  is  represented  by  the  second-order  kernel  of  the  WIENER-identifica- 
tion  scheme.  Orientation  of  the  borderline,  and  thus  the  weight  given  to 
error-conditions,  determines  the  direction  of  this  asymmetry,  as  can  be 
seen  from  the  comparison  of  bi-crosscovariances  (b)  and  (c). 

Often  it  is  argued  that  nonlinear  transfer-characteristics  may  not 
be  of  great  importance  in  manual  control.  We  do  not  agree  with  this 
argumentation,  because  even  small  proportions  of  the  variance  observed 


may  represent  particularly  efficient  behaviour  in  extreme  conditions. 

■  Also  the  total  variance  may  not  be  an  adequate  reference-value  when  the 
variance  accounted  for  by  the  nonlinear  transfer-characteristics  is  in 
the  cross-over  region,  where  it  may  account  for  a  larger  proportion  of 
variance. 

From  these  results  it  can  be  concluded  that  motivation  -  weight 
given  to  various  conditions  which  are  the  outcome  of  actions  -  governs 
the  principles  of  the  control-strategy  used.  If  nonlinear  behaviour  can 
be  induced,  then  also  linear  behaviour  is  a  function  of  the  specific 
experimental  conditions.  Further  experiments  are  directe  d  towards 
identifying  the  rules  which  govern  the  selection  and  profurence  of  the 
_ strategies-.available  to-the-human-operator.  -  -  -  - 

EXPERIMENT  II 

Previous  experiments  (bOSSER  1982)  have  shown  that  control  behavior 
in  the  experimental  situation  investigated  is  adapted  depending  on 
priority  given  to  either  of  the  two  error-conditions.  In  this  experiment 
adaptation  to  various  mixtures  of  weight  given  to  the  two 
error-conditions  were  investigated.  Data  are  shown  from  one  very  well 
trained  and  highly  motivated  subject.  Experimental  conditions  were  the 
same  as  described  above.  There  was  just  one  type  of  input-signal  and  on 
distance  of  the  borderline  in  all  parts  of  the  experiment.  On  four 
consecutive  days  the  subject  was  asked  to  give  different  weight  to  the 
two  error-conditions  (RMS-error  and  line-crossing)  in  nine  daily  experi¬ 
mental  sessions,  from  10/90%  to  90/10%.  The  subject  was  able  to  follow 
this  'fuzzy'  instruction  well. 

On  the  first  two  days  the  subject  was  asked  to  perform  at  his  best, 
on  the  third  day  he  was  asked  to  do  the  task  in  such  way  as  to  make  it 
'easy'  for  him.  Finally  on  the  last  day  an  additional  task  (counting  car 
in  a  TV-film)  was  given  to  the  subject,  in  addition  the  radio  was  turned 
on  loud  and  various  other  types  of  disturbance  were  generated. 

The  results  are  presented  in  the  form  of  a  performance-operating- 
curve:  On  the  assumption  that  the  total  resources  allocated  at  any  one 
time  are  constant,  this  curve  represents  the^  relative  proportion  of  the 
resi^rces  available  to  the  subject  which  are  allocated  to  the  two 
din^nsions  of  the  task.  From  Fig. 6  the  extremely  orderly  curves  of  this 
subject's  perfomance  can  be  seen,  in  view  of  the  unspecific  instruction 
even  more  remarkable.  Although  this  subject  was  outstanding  in  his 
performance  as  compared  to  others,  this  result  demonstrates  clearly  that 
within  a  wide  range  performance  in  the  task  investigated  may  be  adapted 
in  a  continuous  manner  to  the  specific  requirements  imposed.  For  other 
subjects  more  explicit  instructions  and  longer  training  may  be  required 
to  achieve  the  same  result. 

The  obvious  question  to  be  asked  next  is:  What  are  the  conditions 
and  rules  governing  the  adaptation  of  control -behaviour  to 
payoff-conditions? 


9 


EXPERIMENT  III 


In  all  previous  experiments  subjects  were  shown  to  be  able  to  vary 
their  tracking  behaviour  in  response  to  explicit  instructions  to  give 
priority  to  either  of  the  two  error-conditions  defined  in  our  task,  or  to 
weight  these  error-conditions  according  to  certain  ratios.  In  comparison 
real  tasks  would  be  expected  to  have  a  larger  number  of  dimensions 
relevant  for  the  evaluation  of  the  system-performance  of  the  complete 
man-machine-system.  The  human  operator  weights  the  states  of  the  system 
according  to  weighting-functions  which  relate  states  of  the  system  to  a 
utility  associated  with  these  states.  On  this  basis  certain  states  are 
preferable  to  others,  and  the  human  operator  adapts  his  performance 
—  within-the-  range -of-  his  capabilities-  in  such“a  way  as‘  to“  optimize"  the 
total  outcome  of  his  actions.  These  assumptions  are  largely  of  an 
axiomatic  nature  and  not  empirically  testable. 

In  order  to  predict  behaviour  at  selecting  between  different 
behavioural  strategies,  we  have  to  know  the  following: 

*  What  are  the  relevant  dimensions  of  this  utility-space,  and  what  are 
the  weighting-functions  associated  with  the  states  of  the  system,  and 

*  What  are  the  capabilities  of  the  human  to  extract  the  information 
neccessary  to  choose  the  correct  strategy?  Where  the  environment  of  the 
system  consists  of  random-variables,  the  estimation  of  probability-dis¬ 
tributions  is  of  major  importance. 

An  experiment  was  designed  to  test  the  general  applicability  of  sue 
a  model.  In  the  experimental  situation  described  above  one  of  the  task 
variables,  frequency-spectrum  of  the  input-signal,  was  variied.  At  higher 
frequency  of  the  disturbance  the  probability  to  cross  the  borderline 
becomes  larger,  and  corrective  action  (moving  average  value  further  away 
from  the  line)  generates  more  error  on  the  other  error-criterion. 

Subjects  were  paid  according  to  their  performance,  and  the  second 
variable  which  was  variied  experimentally  were  the  payoff-conditions. 

Payment  for  the  subjects  was  based  on  a  rule  of  the  following  kind: 

earnings  =  a  .(RMS-error)  -  b»  (number  of  line-crossings) 

The  amount  deducted  for  line-crossings  (b)  was  vari/ed  from  0  to  .1 
DM  and  .50  DM  per  line-crossing,  in  condition  4  one  line-crossing  was 
free,  the  second  one  was  followed  by  total  loss  of  the  trial's  earnings. 
Subjects  were  not  told  the  payoff-conditions,  but  were  informed  of  the 
result  immediately  following  each  trial.  Gains  and  losses  were  accumu¬ 
lated  and  the  total  amount  paid  at  the  end  of  the  experiment. 

Subjects  were  trained  extensively  without  payment  under  all  the 
experimental  conditions.  Experiments  were  conducted  on  four  conscutive 
days,  cost  of  borderline-transgressions  increasing.  On  each  day  each 
subject  did  twelve  individual  trials  of  307  secs  each,  four  with  the  same 
input-signal  in  random  order.  After  each  trial  of  307  secs  the  subject 
was  informed  about  the  amount  of  money  gained  or  lost  in  that  trial. 
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Results  are  summarized  in  Fig. 7:  In  response  to  lower  gains, 
subjects  adopt  a  control-strategy  where  they  reduce  the  number  of 

linecrossings  at  the  expense  of  a  larger  RMS-error,  and  also  a  larger 

mean-deviation  from  target.  Data  show  the  same  relationship  for  all 
subjects.  Under  the  experimental  conditions  induced  in  this  experiment, 
we  can  be  sure  that  the  subjects  try  to  maximize  earnings.  The  results 
quite  clearly  support  the  hypothesis  that  the  human  controller  adapts  his 
control-strategy  such  as  to  maximize  the  utility  and  to  minimize  expected 
cost . 

DISCUSSION 

In  the  experiments  described  it  was  shown  that  the  human  operator 
has  available  to  him  a  nonlinear  control-strategy  which  may  be  used  when 

the  task  is  structured  such  as  to  require  this  property.  The  WIENER-meth 

od  of  nonlinear-system-identification  is  suited  to  the  description  of 
this  property  of  tracking-behaviour.  The  dimensions  of  performance  are 
not  independent  of  each  other,  they  are  limited  by  the  number  of  behav¬ 
iour  alternatives  available  to  the  human  controller. 

The  behaviour  in  the  situation  investigated  may  also  be  regarded  a 
behaviour  involving  risk-taking  and  decision-making.  Decision-experiments 
are  carried  out  mostly  with  clearly  stated  risks  (probability  of  certain 
resulting  states  multiplied  by  value  of  the  expected  outcome).  These  are 
not  the  situations  typical  for  real  life:  Distance-control  as  part  of  the 
driving-task  is  evaluated  according  to  the  following  (and  others)  dimen¬ 
sions  of  the  utility-space:  Speed  (loss  of  time),  operating  costs, 
comfort  and  probability  of  accident.  The  expected  values  involved  can  be 
regarded  as  the  product  of  the  expected  frequency-distribution  of  states 
of  the  system,  given  a  certain  control-strategy,  multiplied  by  an 
appropriate  weighting-function.  For  each  behaviour-alternative  (strategy) 
an  expected  utility  may  be  calculated  in  this  way. 

The  expected  utility  EV^  for  behaviour  alternatives  aj  ,a2,..ai  and 
dimensions  of  the  utility-space  ,z2,...zj  will  be 

EVi  =  p.^.u.j  +  p.^.u.j  +  +  P...U.. 

where  p^-.  are  the  probability-distributions  expected  for  the  future  state 
of  the  system,  and  ufj  are  the  utilities  associated  with  these  states. 

The  set  of  states  that  may  be  reached  is  limited  by  the  possible 
behaviour  alternatives  the  human  is  capable  of.  He  has  to  choose  between 
the  possible  strategies,  as  exemplified  for  example  by  Fig. 6.  Does  the 
human  optimize  according  to  the  hypothesis  outlined?  In  the  estimation  of 
the  probability-distributions  p  much  error  will  be  involved,  but  this 
does  not  mean  that  the  human  does  not  select  the  best  alternative  on  the 
basis  of  his  faulty  knowlege.  The  problem  is  rather  the  determination  of 
the  number  of  dimensions  of  the  utility-space  and  the  weighting-functions 
associated  with  the  states  of  the  system.  (Motivation  seems  to  be 
exhaustively  described  this  way.)  If  fixed  weighting-functions  according 
to  external  criteria  are  assumed,  the  decision-rules  become  complex,  when 
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it  is  assumed  axiomatically  that  the  human  does  select  an  optimal 
behaviour  strategy,  the  determination  of  the  weighting  functions  becomes 
difficult  because  of  the  large  number  of  dimensions  involved.  The  latter 
point  of  view  seems  to  be  preferable. 

Of  particular  interest  is  the  case,  where  one  of  the  negative 
utilities  involved  is  the  risk  of  accidents.  Results  of  LICHTENSTEIN  et 
al.  (1978)  indicate  that  the  associated  probabilities  can  not  be  esti¬ 
mated  correctly  in  the  case  of  rare  events.  The  same  may  apply  to  the 
estimation  of  the  cost  associated,  which  may  be  unrealistic  before 
exposure  to  a  grave  accident  in  reality.  According  to  the  point  of  view 
advocated  here,  _the  negative  .utility  of  accidents  can  be  compensated- by 
gains  in  other  dimensions  of  the  utility-space,  or,  to  state  this  more 
profanely,  risk  of  accident  will  be  accepted  when  there  is  a  correspond¬ 
ing  gain  in  some  other  dimension  of  the  utility-space. 

We  conclude  that  linear  manual  control  behaviour  is  a  special  case 
restricted  to  certain  error-weighting-conditions.  If  also  asymmetric 
weighting-functions  are  considered  -  some  of  them,  like  the  tendency  to 
avoid  accidents,  can  be  assumed  to  exist  -  nonlinear  control-strategies 
arise  and  the  resulting  behaviour  can  be  regarded  as  the  result  of  a 
decision-process  to  select  an  optimal  behaviour-st^tegy. 
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CONSTANT  POSITION  ERROR  (CM) 

BREAK-FREOUENCY  0.14  HZ,  DISTANCE  OF  BORDERLINE  0.5  CM 
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COMPATIBLE:  SHIFTING  CONTROL  AWAY  FROM  SUBJECT  RAISES 
ERROR-POINTER 
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CONSTANT  POSITION  ERROR  (CM)  ■;  ---f ' 

BREAK-FREQUENCY  0,57  HZ,  DISTANCE  OF  BORDERLINE  t. 

N  «  5  SUBJECTS  v  X  : 

COMPATIH.E:  SHIFTING  CONTROL  AWAY  FROM  SUBJECT  RAISES 
ERROR-POINTER 
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Abstract 

In  this  paper  ^  method  is  proposed  for  the  identification  of  the  pilot's 
control  compensation  using  time  domain  techniques.  From  this  information 
we  hope  to  infer  a  quadratic  cost  function,  supported  by  the  data,  that 
represents  a  reasonable  expression  for  the  pilot’s  control  objective  in  the 
task  being  performed,  or  an  inferred  piloting  '•strategy^.  (Notejhere  ^Cbat^^^ 
we  are  using  the  term  strategy* as  synonomous  with  control  objective,  and 
not  with  control  law.)  The  ultimate  goals  of  this  research  topic  include 
a  better  understanding  of  the  fundamental  piloting  techniques  in  complex 
tasks,  such  as  landing  approach;  the  development  of  a  metric  measurable  in 


simulations  and  flight  test  that  correlate  with  subjective  pilot  opinion; 
and  to  furthenvefWete^pilot  models  and  pilot-vehicle  analysis  methods. 


€o-be^^ 


resented  along  with  the  methodo1ogy,^w444-H}e  some  preliminary  numerical 


results.^^ 


Note,  this  paper  was  presented  at  the  AFFTC/NASA  Dryden/AIAA  Workshop  on 
Flight  Testing  to  Identify  Pilot  Workload  and  Pilot  Dynamics,  Edwards  AFB, 
CA  93523,  January  19-21,1982. 


Introduction 


In  this  paper,  we  will  propose  a  method  for  the  identification  of  the 
pilot's  control  compensation  using  time  domain  techniques.  From  this  in¬ 
formation  we  hope  to  infer  a  quadratic  cost  function,  supported  by  the  data, 
that  represents  a  reasonable  expression  for  the  pilot's  control  objective 
in  the  task  being  performed,  or  an  inferred  piloting  "strategy".  (Note 
here  that-we-are  using  the  term  strategy  as-synonomous  with  control  objective, 
and  not  with  control  law.) 

The  ultimate  goals  of  this  research  topic  include  a  better  understanding 
of  the  fundamental  piloting  techniques  in  complex  tasks,  such  as  landing 
approach;  the  development  of  a  metric  measurable  in  simulations  and  flight 
test  that  correlate  with  subjective  pilot  opinion;  and  to  further  validate 
pilot  models  and  pilot-vehicle  analysis  methods.  At  this  time  we  will  present 
the  methodology  and  some  preliminary  numerical  results. 


The  Pilot  Model  and  Objective  Function 

The  analyses  relies  on  the  well-known  optimal -control  theoretic 
technique  for  modeling  the  human  pilot's  manual  control  function.  The 
hypothesis  upon  which  it  is  based  is  that  the  well  trained,  well  motivated 
pilot  chooses  his  control  inputs  (e.g.  stick  force)  to  meet  the  pilot's 
(internal)  objective  in  the  task,  subject  to  his  human  limitations.  His 
objective  is  further  assumed  to  be  expressible  in  terms  of  a  quadratic 
"cost"  function 


Jp-E 


,T 

lim  1  f /vT 

T-  tI  Cp 


5»p  *  u;  «“p 


(0) 


where  Yp  ■  vector  of  pilot's  observed  variables  (e.g.,  attitude,  acceleration) 
Up  ■  vector  of  pilot's  control  inputs 
Q,R,6  ■  Pilot-Selected  (internal)  weightings 


The  human  limitations  modeled  include  information-acquisition  and  processing 
time  delay,  observation  and  control  input  errors,  and  neuromuscular  dynamics 
A  block  diagram  of  the  resulting  model  structure  is  shown  in  Figure  1. 

The  components  of  this  model  may  be  grouped  into  two  parts,  one  dealing 
with  the  information  acquisition  and  state  estimation,  and  one  related  to 
the  control  law  or  control  policy  operating  on  the  estimated  state.  As  has 
been  shown  in  the  references  on  this  modeling  approaciu  the  "solution"  for 

the  pilot's  control  Inputs,  as  predicted  by  the  model,  is  expressed  as 

•  T  *  T 
u  ®g  x  +  g  u  +  v 
p  ^x  ’u  p  u 

where  x  »  internal  estimate  of  the  system  state 
^x’  9u  *  control  gains 
Vy  ■  motor  noise,  or  control  input  errors 

(Readers  unfamiliar  with  the  further  details  of  the  model  are  referred  to 
the  reference.) 

The  key  points  germain  to  this  analysis  are  that  the  above  equation  is 
a  mathematical  expression  representing  the  pilot's  overt  control  actions 
(Up),  and  these  control  actions  are  measurable  experimentally.  Furthermore, 
the  gains  g^^  and  g^  are  functions  of  the  plant  (vehicle)  dynamics  and  his 
objective  function,  and  thereby  represent  his  control  "techniques",  level 
of  skill,  and  familiarity  with  the  vehicle  dynamics. 

Another  factor  of  importance  is  that  not  only  is  the  objective  function 
from  which  the  gains  are  determined,  a  mathematical  part  of  a  pilot  control 
model,  but  it's  resulting  magnitude  obtained  from  exercising  the  model  has 
been  found  to  correlate  with  the  subjective  pilot  opinion  obtained  from 
simulation  and  flight  test.  Such  a  correlation  is  shown  in  Figure  2,  as  an 


example,  taken  from  Refs.  2  and  3.  This  of  course  assumes  one  has  been  able 


Figure  1,  Hodel  Structure 


0  .4  .8  1.2  1.6  2.0  2.4 


LOSlO  ^Jmodel^  +  ^ 

Figure  2,  Rating  Correlation 


to  correctly  express  the  pilot's  (Internal)  cost  function,  which  Is  In 
fact  his  strategy  that  depends  on  his  perception  of  the  task.  Now  this  is 
easy  to  do  in  simple  laboratory  tasks  In  which  the  subject  has  been  instructed 
to  minimize  some  displayed  error,  for  example.  But  it  is  not  at  all  clear 
Just  what  flight  parameters  are  being  "regulated"  or  "tracked",  other  than 
ILS  glide  slope  and  localizer  error  In  the  case  of  landing  approach.  This 
is  but  one  example,  other  complex  piloting  tasks  might  be  considered  equally 
as  wel  1 . 


The  Identification  Procedure 

We  seek  then  a  method  by  which  we  may  identify  those  pilot  parameters 
that  reflect  his  control  techniques,  or  control  strategy.  Referring  back 
to  the  pilot  model  control  law,  or 

T  -  T 

u  »q  x  +  q  u  +  v 
p  ^u  p  u 

we  note  that  the  gains  g^  operate  on  the  estimated  state  x.  Now  the  separation 
principle  of  optimal  estimation  and  control  theory  states  that  the  control 
gains  (g^^,  g^)  are  independent  of  the  state  estimation  process.  Further, 
the  optimal  state  estimator,  in  general  and  in  the  pilot  model,  is  Independent 
of  the  overall  objective  function  being  minimized  by  the  controller  (estimator 
and  control)  law.  Therefore,  if  we  are  mainly  after  the  pilot’s  control 
strategy  as  expressed  by,  or  at  least  a  function  of,  his  objective  function, 
wc  need  only  to  focus  on  the  gains  (g^,  g^}  and  not  on  those  variables  related 
only  to  the  state  estimator.  These  latter  variables  include  the  time  delay, 
and  observation  and  motor  noise  covariance  matrices,  parameters  of  interest 
in  the  identification  technique  of  Levison  ^4j ,  for  example.  If  our  approach 
is  successful,  fewer  parameters  must  be  identified  from  the  data,  which  is 
always  an  advantage,  but  the  parameters  affecting  the  estimation  process  are 
assumed. 


The  Identification  method  proposed  Is  as  follows.  The  control  law 
expressed  previously,  may  be  rewritten  as 

•  T  T  T 

u  *0  x-a  c  +  Q  u  +  ^ 
p  *x  *x  ^u  p  u 


where  e  »  error  In  estimating  the  true  (actual)  state  x.  Note  that  along 
with  the  pilot's  control  u^.  these  true  states,  such  as  angle  of  attack  or 
pitch  attitude  are  measureable.  but  the  state  estimate,  x.  Is  a  quantity 

A. 

Internal  In  to  pilot,  as  modeled.  Hence  x  Is  not  measurable  —nor  are 
E  or  Vy.  Transposing  the  above,  multiplying  by  x  =  col 
expected  values  yields 


^x,  Upj.  and  taking 


E(xx^)  iE(xuL 

....... A. ...C. 


[E(u/)iE(UpuJ) 


*  I  * 

E(u  c^) I  0 

-  P 


E(xvJ) 
^  u 


or  N/ 


M 


(I) 


Now  to  evaluate  these  matrices  we  note  first  that.  In  a  simulation  at 
least,  the  vectors  x(t)  and  Up(t)  are  measurable,  so  estimates  of  their 
covariance  matrices  (e.g..  E(xx^)}may  be  obtained  from  measurements  of 
sampled  tlm^'  histories.  (Also,  In  this  paper  we  assume  that  good  estimates 
of  are  available  from  filtered  measurements  of  u^.  The  details  of 

p  p 

accomplishing  this  filtering  are  under  current  Investigation,  but  digital 
techniques  as  well  as  analog  methods  are  still  available.)  For  reference, 
refer  to  Figure  3. 
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EXPERIMENTAL  CONSIDERATIONS 


TRACKING  TASK  -  ATTITUDE^  ACCEL.  ... 


•  T  ^ 

Up  -  Gx  Xp  +  Gu  Up  +  Vy 


Figure  3 


with  regard  to  the  remaining  terms  Involving  e  and  v^,  both  are  not 
measurable  and  need  attention.  To  resolve  this  consider  the  complete 
system  dynamics  model  by  the  relation 


X  ■  Ax  +  BUp  +  w 


T  T  T 

“p  ^x  ^u  p  u 

A 

where  the  relation  between  state  and  estimate,  or  x  •  x  -  e  has  been  wployed. 

The  pilot's  Internal  state  estimation  error,  e.  Is  treated  as  follows.  Define 

c  ®  u  -  u  to  be  the  error  In  estimation  of  the  pilot's  own  control  Input, 
u  p  p 

and  then  let 


e  =  col 


Now  the  covariance  of  e  may  be  shown  to  be  governed  by  the  relation 
cov  (e)  =  E(e  e^)  ^  P 


^  Aj  P  +  PaJ  +  Wj 


Also  we  have 


Z  +  E  aJ  +  Wj  -  EC^  V'^  Ce  =  0;  E  =  cov  (e,^c) 


C  =  pilot's  observation  matrix 


■'<<‘-’>1  tv 
U{t-T)  > 

t>  ■ 


These  relations  are  all  obtained  from  Ref.  fS)  and  from  the  pilot  model 
equations  given  in  Ref.  (1).  Here  is  the  Kalman  filter  estimation  error 
for  the  delayed  state,  E  the  covariance  of  e||,p,  and 


Also  W  Is  the  covariance  of  the  plant  disturbance  w,  and  and  are 
motor  noise  and  measurement  noise  covariance,  respectively,  all  assumed 
known.  Now  the  P  equation  may  be  integrated  over  the  time  delay  t,  with 
the  initial  condition  on  P  from  P(0)  ■  i,  the  Kalman  filter  error  covariance. 
Now,  since  the  predictor  has  the  property  that  E(x  e  )  ■  0,  we  have 


So  then  the  terms  E(x  and  ECu^c^)  are  available  from  P,  and  these  are 
required  to  form  M. 

Finally,  it  can  be  shown  (Ref.  (5)),  pg.  331)  that  with  the  processes  w  and 
Vy  uncorrelated  we  have  in  this  case 


£(xJ)  =  0 


V 


u 


Returning  then  to  the  estimation  of  the  gains  (equation  I),  we  see  that 
all  the  terms  in  the  matrices  N^..  and  M  may  be  calculated,  either  analytically 
or  from  the  measurements  of  x.  Up  (and  Up) .  The  estimate  for  the  gain 
vector  is  then 

[r] 

L^uJ  uJ 

Note  finally  that  the  matrix  M  is  formed  from  two  matrices 
M  «  M  - 

X  C  0 

where  the  and  N^^  matrices  may  be  thought  of  as  corrections  added  to  a 
basic  least-squares  technique.  The  potential  importance  of  these  terms  (M 

cor 

and  N^^)  will  be  demonstrated  in  an  example  later. 
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The  algorithm  Is  as  follows: 

1)  Select  noise  covariance  matrices,  W,  V^,  and 

2)  Select  a  time  delay  t, neuromuscular  time  constant  (or  matrix 

)• 

3)  Form  Aj  and  solve  for  Kalman  Filter  error  covariance  e. 


4)  Sol^  fqr  covaHance  matrix _P(_t)  a»id_then_the  E(7_.r^)  Is  available. 
(Note,  all  these  steps  may  be  accomplished  before  or  after  the 
experimental  data  is  obtained.) 

5)  Perform  experiment  to  obtain  state  and  control  (and  control  rate) 
time  histories. 

6)  From  the  time  histories,  obtain  estimates  for  ECxx^),  E(xUp), 


7)  Identify  and  In  £(7  7  )  found  In  step  4. 

8)  Form  M  •  and  determing  j  from  Equation  II. 

9)  Check  gy  vs  (selected  In  2  above)  and  Iterate  (steps  2-8) 
again  as  necessary.  Note  now  that  selecting  affects  the 
solution  for  I  and  P(t),  along  with  the  effective  or 


•  t: 


■1 


“eff  ^ 
while  selecting 


T  only  affects  P(t)  In  the  procedure. 


Comparison  to  Classical  P.esults 

It  Is  Interesting  to  note  that  the  "corrections"  performed  by  Including 
Nv  are  qualitatively  related  to  an  Identification  technique 

cur  y 

(discussed  In  Ref.  6,  and  elsewhere)  used  to  determine  the  human  describing 


function  In  a  compensatory  tasic,  which  goes  back  to  the  development  of  the 
"crossover  model"  of  McGruer  et  al.  Shown  In  Figure  4  Is  a  schematic  of  this 
situation,  showing  the  c1osdd-1oop  tracking  of  some  commanded  d^.  Measurements 
may  be  taken  of  e^Ct),  c(t),  Up(t)  ,  and  e(t)  and  manipulated  In  the  frequency 
domain  to  obtain  frequency  spectra 

-  Up(Ja))/eg(Ja,)  - 

"  e(Ju)/6g(Jw) 

G3(Ja))  -  Up(ju,)/€(Juj) 

Now,  In  this  model  the  pilot's  control  Is  considered  to  consist  of 

two  parts,  one  correlated  with  the  Input  e^,  the  other  uncorrelated  with  the 

input.  The  latter  component  was  defined  to  be  "remnant."  Mathematically, 

r(Ju.)/eg(ij)  0  In  effect. 

Block  diagram  manipulation  leads  then  to  the  desired  relation 
Yp(J«)  •  Gi(Ju))/G2(Ju.) 

rather  than  the  simpler,  and  Incorrect,  expression  Y„(J(i>)  ■  G,(Jw).  This 

P  ^ 

was  due  to  the  presence  of  remnant  r(Ju)  In  the  measured  control  Input,  and 
the  necessity  to  eliminate  It's  effect  by  defining  It  as  the  uncorrelated 
component  of  Up,  and  using  this  property.  Comparing  to  our  control  law, 
transformed  just  for  discussion  purposes,  we  have 

Up(J")  ■  Sx  ®u  ■  sj  ^Cju)  +  Vy(ju)) 

unmeasurable 

separately 

compared  to 

UpCjw)  ■  Yp{Jtti)  eCjui)  +  r(Jy) 

unmeasurable 

separately 


CLASSICAL  RESULTS 


MEASURE  UpCs)  »  Yp  c(s)  +  r(s) 

Yp  «  62(jw)/62(jw)  ^  G3(jw) 
WHERE  62(5)  »  Up(s)/0c(s) 


62(3)  »  e(s)/Oj*(s) 
63(5)  «  Up(s)/e(s) 


V 


The  significant  difference  Is  that  r(juj)  was,  In  effect,  discarded 

in  finding  Y„,  but  gjc  Is  not  uncorrelated  with  x  or  u„  and  must  be  accounted 
*  p  *x  —  p 

for  In  the  Identification  problem. 


A  Numerical  Example 

To  evaluate  the  numerical  properties  and  the  sensitivity  to  the  a  priori 

selected-parameters- (Vy,  W,  V^,  t)  a  fast  time  simulation  of  the  pilot  model 

equations  has  been  assembled,  and  the  simulated  control  task  Is  shown  In 

2 

Figure  5  .  As  shown,  the  task  Is  that  of  pursuit  tracking  with  11.7/s 


controlled  element  dynamics,  and  the  displayed  command  signal  Is  filtered 
white  noise  with  the  filter  transfer  function  given  (e(.(s)/w(s)) .  The 
state  vector  is  shown,  the  known  gain  vector  to  be  Identified  Is  listed,  and 
the  weights  In  the  objective  function  used  are  given.  A  sample  time  history 
of  the  state  and  simulated  pilot's  control  input  Is  depicted  In  Figure  6. 

Such  time  histories  were  sampled  at  10  msec  Intervals  and  the  gains  estimated 
from  time  windows  of  data  5,  10,  15,  20,  25,  30  and  35  seconds  wide.  The 
root- sum- squred  percent  error  of  the  five  estimated  gains  Is  shown  In  Figure  7 


Where 


Li-l*- 


2*11/2 


As  shown,  about  30  seconds  of  data  Is  required  to  obtain  less  than  10%  rss 
error  In  this  example.  Other  dynamics  of  higher  order,  and  therefore  more 
gains,  will  be  evaluated  In  the  near  future  and  the  convergence  will  not 
be  as  rapid. 

The  Importance  of  using  the  proper  corrections  (e.g.,  M  and  ) 

cor 

Is  shown  In  Figure  8  ,  In  which  the  five  exact  gains,  05  are  shown, 
along  with  two  sets  of  gain  estimates.  The  set  labeled  "uncorrected"  was 
obtained  via  straight-forward  least  squares  (I.e.,  and  N  not  Included). 


-  [oc  9c  ®  ®] 

X  *  AX  +  BU  +  N 

ilp  =  gJ  Xp  +  Gu  Up  +  Vy 

[fix  fiul"  [5 '53-  i.86,  -6.76,  -3.69,  -9.281 
Qj  •  16/. 35,  Q-  =  1/.35,  oj  -  1 


Figure  5 
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Conversely,  the  "corrected"  set  used  perfectly  corrected  data,  or  the  actual 

A 

X's  In  the  Identification.  Both  sets  of  gain  estimates  are  based  of  50 
seconds  of  data.  Clearly,  In  this  case  again,  the  corrections  are 
Important.  Further  verification  of  the  method  Is  In  process. 


Inference  of  the  Objective  Function 

Attention  Is  now  turned  to  estimation  of  the  objective  function  weightings 
from  the  gain  estimates  Just  discussed.  (Note,  this  Is  referred  to  In  the 
control  literature  as  the  "Inverse  problem".)  These  weights  are 
related  to  the  gains  via  the  Riccatl  matrix  K,  the  solution  of 


and 


where 


a\  +  KA  +  Q  -  KBG'^i^K  -  0 


■  [O}  I  1  I  ■  Identity  of  dimension  equal  to  u  control 
^  vector 


And  recall  that  Q^,  R,  and  G  are  the  weightings  defined  In  Eqn  (0).  Now 
due  to  the  structure  of  the  OCN,  we  are  able  to  reduce  the  above  Into  some 
simpler  relations.  First,  noting  that  letting  6  ■  ly,  without  loss  of  generality 
(at  least  In  the  case  of  scalar  control  Input  u^),  we  obtain 


and 


f  I 


U  I 


g  g^  +  g^B  +  B^g 
»u*u 


(III. a) 
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(Ill.b) 

(III.c) 


0  ■  9,9„  -  lb  +  a\ 

•  9x9j  -  LA  -  a\ 

Now  L  can  be  eliminated  in  the  last  two  relations  tf  desired,  and  have 


fiVOyCB  •  -  H  -  (IV) 

where - 

H  •  (gu9][  +  g][A)AB 


By  observing  Equation  III  (and  IV)  we  can  see  that  if  estimates  of 
and  g^  are  available,  and  plant  and  observation  matrices  A,  B,  and  C  are 
known,  the  R  weighting  can  be  obtained  directly,  but  requires  special 
attention.  From  Egns.  Ill.b  and  .c  we  see  that  If  L  can  be  obtained  by 
solving  Ill.b,  an  n  x  n  matrix  equation  with  only  C^OC  unknown  results  from 
III.C.  But  this  Is  only  possible  if  B"^  exists,  which  is  only  true  if  the 
number  of  Independent  control  Inputs  (in  Up)  equals  the  number  of  states 
(in  x)-an  unlikely  situation. 

An  alternate  attack  using  Eqn.  IV  leads  to  similar  results.  One  could 
conceivably  solve  for  a  diagonal  Qy  via  a  numerical  method  like  Newton- 
Raphson,  but  that  requitles  the  matrix  CBB^C^  to  be  Invertable.  This  is  possible 
If  the  number  of  control  Inputs  (in  Up)  equals  the  number  of  outputs  (or  y), 

(or  the  system  transfer  function  matrix  is  square).  Although  this  Is  less 
restrictive  than  the  previous  situation,  it  is  also  untrue  In  many  applications 
of  Interest  to  us  here.  So  the  following  conclusions  may  be  stated,  that  In 
general  a  unique  set  of  objective  function  weights  may  not  be  obtainable  from 
gain  estimates  alone.  This  result  Is  not  new,  we've  Just  looked  at  It  In 
the  context  of  our  specific  problem. 


:  O’,  i*.' 
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Although  Improved  methods  are  currently  under  investigation  In  this 
regard,  we  may  always  test  assumed  objective  function  weights  to  determine 


If  they're  feasible.  This  Is  considered  a  reasonable  alternative  since  in 
an  actual  experiment,  the  analyst  knows  several  reasonable  statements  for 
the  objective  function,  and  he  may  at  least  test  them  to  see  which  one  Is 
best  supported  by  the  data.  To  pursue  this  approach,  the  accuracy  of  the 
gain  estimate  will  also  be  developed  such  that  statistical  hypothesis  tests 
may  be  performed.  But  for  now,  this  Is  an  Important  consideration. 

In  the  case  of  our  numerical  example.  Equation  III. a  leads  to  R  =  0, 
and  Equation  IV  yields 


(11.7)2(q.  +  q.)  -  -2(11.7)g^g^^  +  (11.7 

where 

q  0  0  0  * 

0  q,  0  0 

Q  =  ^ 

y  0  0  qg  0 

0  0  0  q- 


Using  the  estimated  gains  we  obtain 

(q*  +  q*)  ■  2.89  (actually  q^  was  1'.35  and  qg  was  0) 


Now  "guessing"  that  q  and  q’  were  2ero,  at  first,  we  may  Iterate  on  q 

w  u  C 

and  solve  III.c,  then  check  with  Ill.b.  If  no  q^  >  0  led  to  a  solution, 
then  the  assumption  of  q^  and  q|  equal  to  zero  would  need  revision.  Finally, 
note  that  from  Equation  Ill.b,  we  can  actually  solve  for  as  many  columns  (and 
rows)  of  L  as  the  number  of  control  Inputs  (or  rank  B),  and  this  part  of 
the  L  matrix  may  be  used  to  check  results  from  III.c. 
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ABSTRACT 

Subjects  used  either  a  joystick  or  a  helmet-mounted  sight  to 
capture  stationary  circular  targets  that  randomly  appeared  on 
a  CRT  screen.  Capture  times  were  longer  with  the  helmet-  mounted 
sight.  For  both  hand  and  head  movements,  Fitts'  Law  was  found 
to  approximate  the  pattern  of  capture  times  along  each  of  eight 
radial  axes  extending  from  the  center  of  the  screen.  Namely, 
capture  times  along  each  axis  increased  as  a  linear  function  of 
the  logarithm  of  movement  distance  divided  by  target  width.  The 
effective  target  width  was  corrected  for  the  noise  distribution 
associated  with  each  control  system's  hardware.  Additionally, 
for  the  helmet-mounted  sight,  mean  capture  times  along  the 
diagonal  axes  were  somewhat  longer  than  along  the  vertical  and 
horizontal  axes.  A  similar  trend  was  found  for  the  hand 
movements,  but  it  was  smaller  in  magnitude  and  not  statistically 
significant.  These  patterns  can  be  used  to  evaluate  various 
composition  rules  for  a  two-dimensional  version  of  Fitts'  Law. 


m  a.  c 


INTRODUCTION 


We  have  undertaken  a  modeling  effort  to  describe  the  pupil¬ 
lary  light  reflex  system,  including  the  retina,  pretectura, 
Edinger-Wostphal  nucleus  and  iris.  There  are  essentially  three 
-types  of-behavior-which  we- wish  our  model  to  describe:  pupillary 
escape,  pupillary  capture,  and  the  asymmetry  of  the  response. 
Pupillary  escape  (as  named  by  Lowenstein  and  Loewenfeld  (1969)  ) 
is  the  phenomenon  that,  when  stimulated  with  a  step  input  of 
light,  the  pupil  will  quickly  constrict,  then  slowly  dilate. 
However,  when  the  pupil  is  initially  small  or  the  intensity  of 
the  input  is  large,  it  will  constrict  more  slowly  and  not 
dilate,  a  process  which  has  been  called  pupillary  capture  (Usui 
(19'M)).  Finally,  when  the  pupil  is  stimulated  by  a  negative 
step  (decrease  in  light  intensity)  the  response  is  a  small 
dilation.  We  feel  these  are  some  of  the  dominant  characteris¬ 
tics  of  the  pupillary  light  reflex  system. 

Early  efforts  to  model  the  pupil  (  Stark(1959), 
Clynes(196l) ,  Tro€stra( 1 968) ,  Webster ( 1971 ) )  dealt  mostly  with 
the  pupillary  escape  and  asymmetry  phenomena.  Semmlow  4  Stark 
(1972)  and  Semmlow  i  Chen  (1977)  developed  models  utilizing 
saturation  of  the  iris  to  describe  the  pupillary  capture 
behavior.  Shimizu  (1977)  proposed  a  model  whereby  the  time  con¬ 
stant  of  the  reponse  changed  with  the  intensity  of  the  stimulus. 


Each  of  these  models  fit  the  experimental  data  for  a  small  class 
of  inputs,  in  a  qualitative  sense. 

The  problem  with  t^""*  above  models  is  that  none  could 
quantitatively  match  the  c  ,  i''  lary  escape  and  capture  responses, 
particularly  when  the  pupi.  i.c  was  small.  Our  goal  in  this 
effort-  is  to  match  that  data  for  a  variety  of-  initial  -con¬ 
ditions.  Our  present  model  rests  on  the  use  of  feedback  from  a 
signal  proportional  to  pupil  size  to  cause  a  change  in  system 
parameters  related  to  gains  and  rates  of  light  adaptation. 

MODEL  DEVELOPMENT 

Sobel  4  Stark  (1962)  proposed  an  internal  feedback  model  of 
the  pupil  in  which  the  parameters  of  the  system  could  be  changed 
by  the  DC  gain.  We  modified  this  after  observing  that  the  pupil 
response  seemed  to  be  a  function  of  the  pupil  size.  We  know  this 
because  pupillary  capture  occurs  when  the  pupil  is  small, 
whether  this  is  caused  by  light  intensity  or  others  factors, 
such  as  accommodation.  This  led  us  to  develop  a  model  utilizing 
feedback  of  tonic  pupil  size  to  change  the  parameters. 

The  model  of  Sobel  &  Stark  has  been  reformulated  to  include 
pupil  size  feedback  nnd  to  create  scpnrntc  tonic  and  phasic 
pathways  through  which  the  input  travels  C  Fig.  1  ].  The 
phasic  (AC)  path  is  a  high-pass  filter  which  responds  to  any 
positive-going  transition.  The  gain  (Kac)  of  this  response 


i..  . 


becomet.  smaller  as  the  tonic  pupil  size  decreases.  The  tonic 
(DC)  path  is  a  low-pass  filter  whose  gain  (Kdc)  depends  on  the 
pupil  size.  A  large  pupil  implies  a  large  Kac  and  small  Kdc, 
while  a  small  pupil  decreases  Kac  and  increases  Kdc.  The 
remaining  elements  of  the  model  (LOG  operator,  third-order  Inte- 
with  delay,  and  iris  nonlinearity)  are  well-established 
for  the  human  pupil. 


FIGURE  1  :  Complete  model  showing  separation  of  AC  and  DC  paths 
and  internal  parameter  control, 

METHODS 

All  of  our  simulations  were  run  on  an  LSI-11/23  (with 
floating  point  hardware  and  graphics  display)  and  took  ap¬ 
proximately  'j  seconds  to  simulate  six  sonoridn  worth  of  dnta. 
The  model  was  reformulated  into  a  state-space  representation  and 
Runge-Kutta  integration  was  performed,  using  multiple-step  and 
sinusoidal  input  functions.  The  model  parameters  were  optimized 
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so  as  to  fit  the  data.  Our  data  was  gathered  using  an  infrared 
television  pupil lometer ,  The  prototypical  data  was  the  average 
of  10  records  from  5  normal  subjects  who  showed  similar 
responses.  The  different  amplitudes  of  light  input  were  accom¬ 
plished  by  inserting  a  neutral  density  filter  in  front  of  the 
light  source.  These  filters  had  effects  of  -5  log  units 
(resulting  in  small  inputs),  -3  log  units  (medium  inputs),  and  0 
log  units  (large  inputs). 

RESULTS 

The  response  of  the  model  to  a  step  input  of  light  is  shown 
in  Figure  2.  It  is  clearly  seen  that  the  model  responds  well  to 
small  and  large  (pupillary  escape  and  capture,  respectively) 
inputs.  The  response  to  the  intermediate  input  displayed  oscil¬ 
lations,  implying  a  more  complex  model  than  that  which  we  have 
suggested.  We  feel,  however,  that  within  the  context  of  the  goal 
--  describing  pupillary  escape  and  capture  —  the  model  matches 
the  data  very  well. 

To  test  the  model  under  the  various  condtions  for  which  it 
was  designed,  we  also  applied  small  and  large  step  inputs  of 
light  to  small  and  large  pupils  (set  Initially  by  accommoda¬ 
tion).  All  three  comparisons  arc  shown  in  Fig.  3t  again  it 
is  seen  that  the  model  provides  an  excellent  fit.  Figure  33 
compares  the  responses  of  pupils  with  similar  initial  sizes  for 
large  (lower  curve)  and  small  (upper  curve)  inputs.  A  small 
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FIGURE  2  :  Pupillary  responses  to  a  step  input  of  licht.  Upper 
graph  is  the  input  stimulus  for  experiment  and  model.  Lower 
graph  shows  pupillary  rosponac  to  a  small  input  (upper  curve), 
medium  input,  and  large  input  (lower  curve).  Experimental  data 
is  represented  by  dashed  lines,  model  data  by  solid  lines. 
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input  was  applied  to  different  initial  pupil  sizes  C  Fig.  3b  ] 
to  show  that  pupillary  capture  occurs  in  the  small  pupil,  while 
escape  occurs  in  the  large  pupil,  although  the  inputs  were 
identical.  Large  inputs  were  also  applied  to  small  and  large 
pupils,  yielding  the  responses  shown  in  Figure  3c.  As  was 
expected,  capture.occurred  .for__each_ of.  the  initial  conditions.. 
We  can  therefore  conclude  that  the  necessary  conditions  for 
pupillary  escape  are  small  light  input  and  large  initial  pupil 
size . 

In  order  to  prove  that  pupillary  capture  is  not  merely  a 
saturation  effect,  as  has  been  proposed*,  the  pupil  was  stimu¬ 
lated  with  a  large  double  step  of  light.  If  the  pupil  was 
saturated,  the  second  input  would  cause  no  change.  That 
however,  was  not  the  case  C  Fig.  4  3.  The  figure  shows  that  the 
pupil  continues  to  constrict  when  an  additional  stimulus  is 
presented . 

The  final  comparisons  used  to  tune  the  parameters  of  the 
model  were  via  the  velocity  and  phase  plane  graphs  [Figs.  5  &  6] 
Again,  it  is  seen  that  the  fit  is  quite  good  for  the  large  and 
small  inputs,  and  satisfactory  for  the  intermediate  input. 

As  was  mentioned  above,  the  gains  Kac  and  Kdc  are  functions 
of  the  tonic  pupil  size.  To  simplify  the  model,  the  relations 
were  approximated  by  piecewise  linear  functions.  While  a  more 
complex  function  may  have  provided  a  better  to  the  data,  the 
limitations  of  the  data  at  hand  dictated  a  simple  relation. 
With  this  in  mind,  the  parameters  of  the  final  model  [Fig.  73 
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FIGUIIE  U  :  PupilUiry  rcaponse  to  double  step  input  of  light. 
Upper  grnph  shows  double  step  input  for  model  and  experiment. 
Lower  graph  shows  response  to  small  inputs  (upper  curve),  medium 
inputs,  and  large  inputs  (lower  curve). 
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FIGURE  6  :  Phase  plane  trajectories  of  model  (solid)  and 
experimental  (dashed)  data  for  small  (A),  medium  (D),  and  large 
(C)  inputs.  Pupillary  escape  yields  the  circular  form  shown  in 
(A),  while  pupillary  capture  yields  the  open  form  of  (C) . 
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are  as  follows  : 

T1  =  0.085 
T2  s  0.15 
T3  =  0.28 
Td  =  0.2 

Kac  (large  pupil)  s  1.0 
Kac  (med.  pupil)  s  0.9 
Kac  (small  pupil)  s  0.85 
Kdc  J large  pupil),  =  0.035-- 
Kdc  (med.  pupil)  =  0.085 
Kdo  (small  pupil)  =  0.17 


FIGURE  7  :  Results  of  simulation  with  parameter  values  shown. 


DISCUSSION 


Before  attempting  apr>ther  pupil  model,  some  of  the  afore¬ 
mentioned  pupil  models  were  used.  However,  no  matter  how  the 
parameters  were  changed,  the  models  would  not  agree  with  the 
available  data.  In  particuar,  Shimizu's  model,  although  working 
for  large  initial  pupil  size,  could  not  fit  the  data  when  the 
initial  pupil  size  was  small.  Our  experience  with  these  models 
lent  insight  towards  what  we  considered  a  "better"  model,  such 
as  separating  the  AC  and  DC  pathways  of  the  response.  It  was 
felt  this  was  valid  because  the  initial  (phasic)  response  to  a 
step  seemed  relatively  independent  of  the  final  value  which  it 
would  attain.  Also,  it  was  felt  that  the  main  difference 
between  pupillary  escape  and  capture  was  that  the  DC  path  in¬ 
creased  its  gain  for  capture  while  the  AC  path  decreased  its 
gain.  Since  the  data  sugggested  that  pupillary  capture  was 
dependent  upon  tonic  pupil  size,  we  could  then  feed  pupil  size 
back  to  adjust  the  DC  and  AC  gains,  a  process  which  seemed 
physiologically  plausible. 

By  applying  a  double-step  input  of  sizable  intensity,  we 
showed  that  the  iris  saturation  model  was  not  plausible.  The 
idea  in  this  model  is  that  pupillary  capture  is  merely  an  escape 
which  has  been  saturated.  Clearly,  from  Figure  4,  one  can  see 
that  there  is  no  saturation  effect,  since  the  pupil  continues  to 
constrict  when  another  input  is  applied.  This  suggests  that 


pupillary  capture  is  a  mechanism  In  its  own  right,  rather  than 
Just  a  special  case  of  pupillary  escape. 

Throughout  these  studies,  pupil  area  was  used  as  a  measure 
for  pupil  size,  because  it  is  slightly  less  sensitive  to  noise 
in  the  data  collection  process.  However,  diameter  could  have 
been  used  without  ill  effects  in  the  model  (diameter  is.  often 
used  to  measure  pupil  size).  The  only  difference  would  be  in 
the  functions  relating  Kdc  and  Kac  to  pupil  size,  but  since 
these  are  arbitrary  nonlinear  functions,  new  functions  could  be 
found  without  harming  the  contracts  of  the  model. 

A  model  with  separate  AC  and  DC  pathways,  besides  yielding 
better  modeling  and  control,  is  more  realistic  physiologically. 
The  AC  path  corresponds  to  the  (fast)  Y  cells  in  the  retina, 
while  the  DC  path  corresponds  to  the  (slow)  X  cells  in  the 
retina.  Each  path  reacts  differently  to  different  levels  of 
light.  For  Instance,  large  pupils  are  usually  associated  with 
scotopic  (night)  vision.  In  this  condition,  it  is  less  lmpor> 
tant  for  the  pupil  to  regulate  the  long-term  light  flux  onto  the 
retina  via  the  pupil,  Implying  that  the  AC  path  dominates  and 
that  pupillary  escape  occurs  in  the  large  pupil.  Conversely,  a 
small  pupil  (about  M-5  mm)  is  generally  indicative  of  photopic 
vision  conditions.  In  this  case,^  regulation  of  light  flux  into 
the  eye  becomes  more  important,  and  the  DC  path  becomes 
prominent.  Finally,  by  using  pupil  size  as  a  feedback  control 
variable,  we  can  assume  this  happens  at  the  level  of  the 
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Edinger-Westphal  nucleus. 


CONCLUSION 


This  model  shows  that  internal  pupil  size  feedback  is  a 
valuable  tool  in  determining  the  pupil  response  to  light.  The 
model  of  course  fits  the  standard  pupillary  escape  movement,  but 
more  importantly,  it  fits  the  pupillary  capture  movement  as 
well.  Changing  the  initial  conditions  via  accommodation  shows 
that  the  pupil  size,  not  background  light  intensity,  controls 
the  capture  mechanism.  It  was  also  shown  that  the  old 
saturation  model  of  capture  is  not  plausible  by  applying  a  two- 
step  input.  Finally,  it  was  seen  that  separating  the  model  into 
tonic  and  phasic  paths  is  reasonable  both  physiologically  and 
from  a  modeling  point  of  view. 

It  is  hoped  that,  in  the  future,  the  model  can  match  the 
int ’.-mediate  (partial  escape  and  capture)  response  of  the  pupil. 
The  small  oscillations  present  in  the  data  suggest  that  there  is 
perhaps  a  delay  in  the  pupil  size  feedback  mechanism.  Initial 
tries  at  implementing  this  have  not  yet  given  good  results. 
Another  possibility  is  a  Volterra  series  model  of  this,  or  per¬ 
haps  even  a  hybrid  of  the  two.  Overall,  however,  it  is  felt  that 
this  model  is  a  valuable  tool  in  the  study  of  the  pupil. 
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characterize  the  way  the  human  operator  behaves  in  a  manner  consistent  with 
his  description  of  machine  functioning,  i.e.,  that  he  be  able  to  model  and 
predict  the  performance  of  the  operator  as  a  component  of  the  man-machine 
system  (1). 

Since  the  work  of  the  human  operator  model  by  Tustin,  many  investigators 
have  proposed  different  models  to  quantitatively  represent  human  operator 
dynamics  (1-7).  Recently  a  powerful  new  method  utilizing  time  series  analysis 
has  been  considered  as  one  of  the  promising  tools  among  those  techniques  (2, 

7,  9).  Shinners  (2)  and  Tanaka,  Goto,  and  Wasizu  (7)  have  applied  the  time 
series  analysis  to  their  models  of  the  human  operator.  These  investigators 
used  the  methods  of  Box  and  Jenkins  and  Akaike's  information  criterion  (AIC) 
respectively  to  estimate  the  order  and  the  value  of  parameters.  Shinners  (2) 
obtained  the  transfer  function  of  the  human  operator  in  compensatory  tracking 
with  a  controlled  element  of  unity  gain  in  the  following  form: 


/_\  _  -0. 65(1-0. 803z  )z 

OuU)  =  - ' — TT^ — - n —  U; 

"  (l-0,386z  )  (1-0. 97z  ) 

where  is  the  backward  shift  operator,  namely  z"^x(k)  =  x(k-l). 

Using  the  Normalized  Residual  Criterion  (NRC)  of  Suen  and  Liu  (8)  to 
estimate  the  order  and  the  values  of  the  parameters,  Agarwal  et.  al.  (9,  14) 
have  obtained  the  transfer  function  of  the  human  operator  in  both  compensatory 
and  pursuit  tracking  modes.  One  of  their  models  in  compensatory  tracking  is 
given  by: 


Gh(z) 


-0.106(l-z~S 
(l~z"  )  (1-0.479Z'  ) 


(2) 
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These  time  series  analysis  methods  have  the  advantage  that  they  require 
much  smaller  data  lengths  than  the  techniques  based  on  fourler  transform 
methods.  Thus,  changes  In  human  operator  dynamics  could  be  studied  much  more 
effectively  than  hereto  possible.  The  purpose  of  the  present  paper  Is  to 
Investigate  how  sampling  Interval  and  measurement  noise  would  Influence  the 
“results  In  using  time  series  techniques.  -  _  _  _  _ 


METHODS  AND  DATA  ANALYSIS 

For  the  purpose  of  evaluating  the  time  series  technique  used  In  the 
Identification  of  the  human  operator  dynamics  a  controlled  set  of  Input-output 
data  Is  generated.  Figure  1  shows  the  relationship  between  Input  and  output 
of  the  man-machine  system  considered  In  this  paper. 


Controlled 

Process 

C 


Figure  1 

The  Input  x(t)  Is  synthesized  by  adding  five  . on-harmonic  sine  waves 
5 

x(not)  -  I  A.  Sln[2nf.  (nat)]  (3) 

j-1  •’ 

n  •  0,  1 ,  2,  ... 

The  frequencies  and  amplitudes  were  chosen  from  the  STI  data  (10)  as 


follows: 


J 


The  human  operator  transfer  function  and  the  controlled  process  (tynamics 
were  chosen  from  Shirly's  work  (11)  as  follows; 


With  the  Input  and  the  system  dynamics  defined  as  above,  the  output 
Is  obtained  by  solving  the  linear  differential  equations  by  using  the  fourth 
order  Runge-Kutta  method  with  at  «  0.01  seconds.  The  regression  analysis  was 
done  by  using  MINITAB  2  statistical  software  package  on  an  IBM  computer.  The 
first  five  seconds  of  the  Input-output  data  sequence  were  not  used  to  allow 
the  Initial  transient  to  die.  The  Input-output  data  sequences  were  sampled  at 
four  different  sampling  Intervals  of  0.01,  0.02,  0.1  and  0.2  seconds  to 
Investigate  the  effect  of  the  sampling  period.  This  analysis  was  repeated 
with  measurement  noise  n(t)  added  to  the  output  signal.  This  Gaussian  noise 
signal  was  digitally  generated  with  mean  y  «  o  and  the  standard  deviation 
a  •  0.25  or  0.5.  To  obtain  the  parameter  values,  100  or  200  observation 
points  were  used. 

The  transfer  function  model  using  n  lags  on  output  and  m  lags  on  Input, 
TF(n,ra),  1s  specified  by  the  equation 

n  m 

y(t)  *  z  fliy(t-l)  +  I  0  x(t-J)  +  v(t)  (5) 

1-1  1  j-0  j 

(m^n) 
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The  parameters  n  and  m  were  chosen  using  the  Normalized  Residual 
Criterion  (8).  This  method  has  been  outlined  earlier  In  Agarwal  et.  a1. 
(9.14).  The  coefficients  and  are  obtained  In  the  regression 
analysis. The  residuals  v(t)  are  minimized  In  the  MIC  method  and  for  the  chosen 
model  must  have  white  noise  properties.  The  normalized  sum  of  the  squares  of 
res1duals-1s  glvenby-  -  - 


e  (n.  m,  T) 


(6) 


Where  j|yjj  denotes  the  sum  of  the  squares  of  residuals  and  |y|| 
denotes  the  sum  of  squares  of  the  output.  The  quantity,  e  (n.  m.  T).  Is 
proportional  to  the  normalized  variance  of  the  regression  for  a  given  n  and 
m.  If  this  ratio  Is  minimized  over  n  and  m.  then  the  data  fit  as  measured  by 
the  correlation  coefficient  p  will  be  maximized.  1.e.» 


p 


[1  -  e  (n.  m) 


(7) 


where  T,  being  a  constant  for  the  data.  Is  omitted  In  the  expression,  and 

A 

e  (n,  m)  Is  the  minimum  value  for  e  (n.  m.  T). 

Values  of  e  (n,  m)  were  computed  for  several  sampling  Intervals,  with 
and  without  noise  and  plotted  against  different  values  of  n  as  shown  In  Figure 
2  for  two  different  sampling  Intervals,  without  noise.  In  a  typical  example 
of  Figure  2-a,  all  curves  turn  flat  at  n  ■  2,  and  this  Is  chosen  as  the 
optimal  value  of  n.  After  determining  the  value  of  n.  the  optimal  value  of  m 
Is  selected.  Since  there  Is  no  apparent  explanatory  difference  provided  by 


NORMALIZED  RESIDUAL  NORMALIZED  RESIDUAL 


models  with  m  >  1,  m  *  1  is  chosen  as  the  best  value.  To  add  statistical 
significance  to  this  selection  of  model  order,  note  that  the  critical  test  is 
whether  for  m  >  1,  one  can  justify  going  from  n  ■  1  to  n  ■  2.  Since  (13), 


(8) 


is  F(n2  -  n^,  T  -  n2)  distributed  for  large  T.  We  tested  this  difference  in 
going  from  nj  =  1  to  n2  ®  2.  For  example,  in  Figure  2-b,  for  m  =  1  in  TF 
model,  using  T  »  98,  nj^  =  1,  and  n2  =  2,  A  *  29300  is  obtained.  Since  the  F 
distribution  tables  gives  Fq  gj(l,  120)  *•  6.85,  it  is  clear  that  the  data 
decisively  rejects  the  hypothesis  of  no  significant  difference  in  normalized 
residual  for  n  <*  1  and  n  >  2. 

The  resulting  estimated  model  of  the  human  operator,  in  the  case  without 
measurement  noise,  can  be  written  in  the  following  form: 


y(t)  •  oiy(t-l)  ♦  a2y(t-2)  t  6o*(t)  *  eix(t-l)  +  v(t)  (9) 

This  form  of  the  model  is  the  same  as  the  one  for  high  frequency  case  of 
Agarwal  et.  a1 .  (9).  This  analysis  was  repeated  at  sampling  Intervals  of 
0.01,  0.02,  0.1  and  0.2  seconds. 

Effect  of  Noise  on  Model  and  Parameter  Estimation 


distribution  of  zero  mean  and  S.D.  of  0.25  or  0.5. 

The  output  with  nolsr  and  Its  predicted  value  by  the  estimated  equation 
are  shown  for  a  sampling  Interval  of  0.1  seconds  In  Figure  3.  Note  that  the 
optimal  model  order  has  been  changed  to  TF  (4,2)  with  measurement  noise 
present. 


Residual  Analysis 

A 

Several  statistical  tests  are  performed  on  the  estimated  residuals  v(t) 
which  were  assumed  to  have  a  normal  distribution  and  statistically 
Independent.  The  normality  can  be  examined  quantitatively  by  the  goodness-of- 
flt  test  based  on  the  quantity: 


X 


2 


k 

l 

1=1 


®1 


(10) 


where  o^  and  e^  represent  the  observed  and  expected  frequencies,  respectively 
for  1  th  cell.  The  sampling  distribution  Is  approximately  the  Chi-square 
distribution  with  K  -  1  degrees  of  freedom,  where  K  Is  the  number  of  Intervals 
for  a  given  histogram.  For  example,  for  100  ms  sampling  using  a  7  Interval 
histogram  ■  10.70.  Since  this  Is  less  than  12.592,  the  value  for  x^  g  05 
for  6  degrees  of  freedom,  the  hypothesis  that  the  residuals  come  from  a  normal 
population  cannot  be  rejected  at  the  0.05  level  of  significance.  From  this 
test  It  Is  concluded  that  the  residuals  are  almost  certainly  from  a  normal 
distribution. 

A 

Although  v(t)  values  pass  che  normality  test  well,  they  might  be 
autocorrelated.  From  several  autocorrelation  tests,  the  standard  'runs' 


ESTIMATED  OUTPUT  SYSTEM  OUTPUT 


SAMPLING  INTERVAL  0.1  SEC 
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MODEL  ORDER  N=4,M=2 
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P.UflUUE  OF  OUTPUT  WITH  NOISE^M'O.  S.0.=0.25 
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Fig.  3-b 
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randomness  test  was  selected  to  apply  because  this  method  is  so  simple  and 
reliable.  In  this  case,  since  the  v(t)  has  zero  mean,  replacing  each 
residual  by  the  sign  (+)  If  It  1s  greater  than  0,  by  the  sign  (-)  If  It  Is 
less  than  0,  the  sequence  of  (■»■}  and  (-)  are  obtained.  When  n^  Is  the  number 
of  signs  (+),  ng  the  numbers  of  signs  (-)  respectively,  the  test  whether  the 
arrangement  of  the  signs  Is  random  Is  based  on  the  statistic: 


u  -  u 


where: 


n^  +  n  2 


^2njn2{2nin2-ni-n2) 


(ni  +  n2)  (ni  +  n2-l) 


and  u  Is  the  number  of  runs. 

For  example,  for  100  ms  sampling  with  noise:  (u  *  0,  o  “  0.5),  this 
sequence  has  46  runs  and  n^  °  45  and  n2«  51.  Since  Z  »  >0.58,  which  is  less 
than  Z  g  Q5  -  1.96,  the  hypothesis  that  the  arrangement  of  signs  (and  hence, 
the  residual)  Is  random  can't  be  rejected  at  the  0.05  level  of  significance. 


Transfer  Function  of  System  and  Human  Ooerator 
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where  H(z)  Is  the  transfer  function  of  the  discrete  system.  This  equation 
defines  the  closed-loop  transfer  function  of  the  system.  For  example,  for  100 


ms  sampling  without  noise, 

-0.315  +  0.628z“^  6u(z)C(z) 

H(z)  -  - - - -  -  -= -  (13) 

1  -  1.384z"  +  0.699z'  1  +  Gj^(z)C(z) 


where  human  operator  transfer  function  and  C(z)  1s  the  plant's 

transfer  function  respectively.  From  (13), 

Gh{z)C{z)  - - t ^0-»^78z - ^ 

"  1  -  1.530Z"  +  0.532z" 


The  2  transform  m^y  be  converted  Into  a  Laplace  transform  using  the  following 
relations: 


)  - 


1 

s  +  a 


(15) 


Z  (e 


where  T  Is  the  sampling  Interval. 

In  Laplace  transform,  equation  (14)  becomes: 


The  plant's  clynatnics  Is  given  as  C(s)  -  j  ,  therefore 


The  terms  of  s  and  (s  +  0.04)  are  fairly  close  and  may  be  cancelled. 
Therefore  an  approximate  model  of  the  human  operator  Is  obtained  In  the 
following  form: 


The  results  of  this  analysis  for  sampling  intervals  of  0.01,  0.02,  0.1 
and  0.2  seconds  are  given  in  Table  1  for  cases  without  measurement  noise  and 
in  Table  2  with  measurement  noise. 

In  Table  1,  the  gain  value  Increases  from  0.047  to  0.24  as  the  sampling 
Interval  Is  Increased,  but  1c  Is  very  different  from  the  given  value  of  k  ■  5. 
The  chosen  pole  and  zero  locations  were  -8.7  and  8.7,  respectively.  The 
sampling  interval  of  10ms  yielded  the  best  approximation  to  these  values, 

I.e.,  -8.45  and  8.87.  With  Increasing  sampling  Interval  the  location  for  zero 
moved  to  9,63,  13.38  and  finally  to  18.20  at  0.2  second  sampling.  The 
movement  of  the  pole  position  was  much  smaller. 

The  transfer  function  models  with  measurement  noise  were  much  more 
complex  and  most  of  these  could  not  be  converted  to  the  Laplace  transform 
domain.  In  the  Z-domaIn  these  transfer  functions  are  significantly  different 
from  the  equivalent  zero  noise  cases. 
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TABLE  1.  TRANSFER  FUNCTION  MODEL:  WITHOUT  NOISE 


S.0.=0.5  1-1.0392“  +0.0452 


Although  the  time  series  analysis  is  a  powerful  and  reliable  technique, 
the  sampling  interval  and  measurement  noise  will  influence  the  model  order  and 
the  parameter  values  obtained.  Modeling  of  the  closed-loop  systems  makes  the 
problem  even  more  difficult. 
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ABSTRACT 


Joint  compliance  was  measured  at  both  the  wrist  and  ankle  by 
applying  various  torque  waveforms  (step,  sinusoidal,  and 
random)  about  the  joint  while  measuring  the  resulting  joint 
angle.  Stretch-evoked  electromyogranhic  activity  (EMG)  was 
recorded  from  agonist-antagonist  muscle  pairs  at  the  joint 
oeing  tested.  Measurements  were  made  on  normal  human  subjects 
before  and  after  the  development  of  perioheral  ischemia  in  the 
limb.  Ischemia  is  thought  to  preferentially  block  conduction 
in  large  diameter  nerve  fibers.  Before  ischemia  developed, 
feedback  from  primary  muscle  spindles  was  intact.  As  ischemia 
developed,  this  feedback  was  reduced  or  eliminated. 

Under  normal  conditions,  the  compliance  measured  by  sinusoidal 
techniques  is  dependent  on  input  amplitude  and  the  resting 
level  of  contraction  in  the  muscle.  However,  for  any  given  (ipoan 
level  of  contraction  and  RMS  level  of  perturbation,  the 
compliance  is  often  well  fitted  by  a  second  order  linear 
system.  ^Vhen  ischemia  developed,  changes  in  compliance  were 
seen  at  low  frequencies.  In  terms  of  a  second  order  mechanical 
system  model,  these  changes  were  observed  in  the  stiffness  and 
viscosity  parameters,  and  not  in  the  moment  of  inertia.  The 
observations  are  strongly  dependent  on  the  leve^  of  muscle 
fatigue  during  the  the  development  of  ischemia. '*rhere  was  aTso 
a  concomitant  loss  of  stretch-evoked  EMG  during  the  ischemia. 

The  functional  role  of  stretch-evoked  SMG  has  always  been 
controversial.  These  data  suggest  a  relationship  between 
mechanical  characteristics  of  the  joint  and  the  stretch-evoked 
EMG,  and  quantify  the  mechanical  contributions  stretch-evoked 
(i.e.  reflex)  responses  make  to  joint  compliance. 


INTRODUCTION 


In  studying  man-machine  Interactions  one  is  concerned  with  a 
number  of  issues.  One  of  these  is  how  quickly  a  human 
operator  can  voluntarily  respond  to  disturbances  in  the  system. 
Another  concerns  determining  a  mathematical  transfer  function 
of  the  human  operator  which  also  incorpoirates  the 
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"involuntary"  component  of  the  response.  Both  of  these  issues 
are  difficult  to  resolve  because  of  the  complexities  of  the 
system.  The  oarticular  complexity  of  the  human  operator  we  will 
focus  on  in  this  paper  is  one  of  the  internal  feedback  systems 
within  the  human  operator  -  the  muscle  spindle  loop,  one  way 
in  which  the  operation  of  this  system  may  be  observed  and 
studied  is  by  the  stretch-evoked  myotatic  response,  and 
possibly  the  resulting  mechanical  responses. 

_ We -have- attempted- to  . study-thia  system  in- both  -the  normal, 

closed  loop  case  and  in  an  altered  case  with  the  muscle  snindle 
feedback  pathway  disabled.  In  the  latter  case,  this  was  done 
by  inducing  ischemia  in  the  limb  to  block  conduction  in  large 
diameter  afferent  nerve  fibers  from  the  spindles. 

-With  regard  to  how  quickly  a  human  operator  can  respond  to 
perturbations  in  the  system  which  manifest  themselves  in  sudden 
movements  of  the  control  maninulandum,  it  is  clear  that  reflex 
responses  have  the  potential  to  act  most  rapidly.  There  has 
been  considerable  controversy  regarding  the  function  of  early 
stretch-evoked  SMG  responses.  An  early  view,  proposed  by 
Merton  (1953)  was  that  stretch  evokes  a  myotatic  response  in 
the  muscle,  mediated  by  the  primary  muscle  spindle,  which  tends 
to  return  the  muscle  to  its  original  length.  This  is  the 
classic  concept  of  load  compensation,  which  states  that  length 
is  the  regulated  variable.  While  this  hypothesis  has  fallen 
out  of  favor  due  to  various  demonstrations  that  length  is  not 
"well  regulated",  it  must  be  kept  in  mind  that  the  design 
criteria  and  the  definition  of  good  performance  for  the  human 
motor  system  are  not  available  to  us. 

Another  view  is  that  the  myotatic  response  is  produced  by 
motor  units  that  were  about  to  fire  irrespective  of  the  stretch 
stimulus,  and  as  such,  this  response  is  an  "epiphenomenon  of 
little  physiological  consequence"  (Hammond  et  al,  1956).  This 
view  was  strengthened  by  the  observation  that  the  myotatic 
response  in  the  soleus  produced  insignificant  muscle  tension 
compared  with  the  later  response,  which  w.’.s  termed  the 
"functional  stretch  reflex"  (PSR).  The  Implication  here  was 
that  the  myotatic  response  was  not  functional  (Melvill  Jones 
and  Watt,  1971), 

However,  anatomical  structures,  such  as  the  muscle  spindle  and 
the  monosynaptic  reflex  arc,  rarely  exist  without  a  specific 
physiological  function  or  functions.  'Vhile  the  first  of  the 
two  proceeding  views  suggested  the  function  of  length 
regulation,  the  second  rejected  any  functional  role  for  the 
.myotatic  response.  The  truth  probably  lies  somewhere  in 
between.  Much  of  the  theoretical  thinking  concerning  the  human 
motor  system  has  been  guided  by  supposed  evolutionary 
considerations  which  suggest  that  the  monosynaptic  reflex  arc 
is  phylogenetically  old,  and  that  higher  centers  have  evolved 
around  it.  Wauta  and  Feirtag  (1979)  have  speculated  that  the 
monosynaptic  reflex  arc  may  be  relatively  new  on  the  presumed 
evolutionary  scene.  This  speculation  impliea  some  important 
functional  role  for  the  muscle  spindles  and  the  myotatic 
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response,  but  what  that  might  be  remains  unclear. 

One  of  the  more  recent  hyootheses  concerning  the  function  of 
early  stretch  evoked  EMG  activity  is  that  this  activity 
regulates  the  internal  prooerties  of  the  muscle,  specifically 
its  stiffness.  In  this  hypothesis,  segmental  mechanisms  act 
to  maintain  the  stiffness  of  the  muscle  in  the  face  of 
changing  external  loads  and  descending  motor  commands,  rather 
than  simply  regulating  the  length  of  a  muscle  at  some  sat 
point  (HouK.  1979). 

-  With  respect “tO“ determining  a  correcf mathematical  transfer 

function  of  the  human  operator,  attempts  to  model  and  simulate 
the  neuromuscular  system  have  always  been  frustrated  by  the 
lack  of  adequate  block  diagrams  of  the  system.  This  reflects 
our  lack  of  understanding  of  the  neural  circuitry  involved. 

For- example,  attempts  at  modeling  ballistic  movements  to 
determine  the  role  of  spindle  feedback  have  yielded  conflicting 
results  (Dijkstra  and  Denier  van  der  Gon,  1973;  Van  Oijk, 

1973).  It  is  for  this  reason  that  functional  changes  in  the 
presence  and  absence  of  spindle  feedback  were  studied  here 
using  only  torque  input  and  joint  angle  output  rather  than 
resorting  to  neuroanatomical  block  diagrams. 

Studies  which  address  the  function  of  stretch-evoked  EMG 
activity  involve  careful  quantification  of  the  EMG,  torque 
perturbation,  and  joint  rotation.  Attempts  to  determine  the 
biomechanical  properties  of  different  joints  have  used  a 
variety  of  torque  waveforms  as  inputs  and  measured  the  joint 
angle  as  the  output.  At  a  minimum,  this  requires  a  linear 
second  order  model  which  includes  moment  of  inertia,  viscosity, 
and  stiffness  terms.  Compliance  is  shown  in  the  following 
equations 


where  J*moroent  of  inertia,  B«angular  viscosity  coefficient, 
KBanquiar  stiffness,  s**comnlex  radian  frequency,  9-joint  angle, 
and  "C  -torque.  For  the  totally  denervated  case,  such  a  simple 
second  order  model  would  be  a  good  first  choice.  Torques 
applied  to  the  joint  would  be  resisted  by  the  passive  inertia 
of  the  joint  and  the  visco-elastic  stiffness  of  the  joint, 
muscles  and  connective  tissue. 

In  the  Intact  system,  however,  neural  control  loops  exist 
which  cannot  as  yet  be  precisely  specified,  and  are 
superimposed  on  the  mechanical  system  of  muscles,  bones,  and 
other  tissues.  This  introduces  the  distinct  possibility  that 
the  system  being  modeled  is  chanqino  with  time,  and  this  would 
be  reflected  in  the  model  parameters.  An  example  of  this  is 
the  observed  change  in  joint  compliance  seen  with  changes  in 
muscle  tone  (Agarwal  and  Gottlieb,  1977).  Mevertheless,  it 
still  may  be  possible  to  apply  a  second  order  linear  model, 
with  the  underetanding  that  the  stiffness  and  viscosity  so 
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determined  are  not  directly  comparable  to  the  underlying 
biomechanical  system  in  the  denervated  case,  but  rather 
represent  some  type  of  “equivalent"  viscosity  and  stiffness. 

Another  problem  with  the  simple  second  order  model  arises  in 
the  situation  when  voluntary  intervention  is  present.  In  this 
case,  additional  torques,  which  are  difficult  to  measure,  are 
applied  about  the  joint,  after  an  appropriate  reaction  time. 
Reflex  contractions  which  precede  a  voluntary  response  may 
also  produce  significant  torques  about  the  joint.  Finally,  it 

roust  be  noted- that -the  properties- of  muscle  vary -with  the - 

length  and  velocity  of  contraction.  Thus  the  B  and  K  values 
would  again  be  expected  to  change.  This  implies  possible 
amplitude  and  frequency  dependent  nonlinearities. 


METHODS 

Subjects  I  Normal  human  subjects  between  the  ages  of  22  and  40 
were  used.  Ail  were  in  good  health  with  no  current  medical 
problems.  The  experiments  were  approved  by  the  Rush 
Presbyterian-St .  Luke's  Committee  on  Human  Investigation  and 
informed  consent  was  obtained. 

Ischemia  I  Ischemia  was  induced  by  applying  a  standard  arm  or 
leg  sphygmomanometer  cuff  around  the  upper  part  of  the  limb 
and  rapidly  Inflating  it  to  a  pressure  of  150  mm  of  mercury. 
Typically,  the  duration  of  the  ischemia  was  25  to  35  minutes. 

In  no  case  was  Ischemia  induced  in  the  same  limb  of  a  given 
subject  without  a  minimum  recovery  period  of  seven  days. 
Following  collection  of  ischemic  data,  the  cuff  was'  rapidly 
deflated  by  "popping”  the  valve  of  the  cuff  and  allowing  it  to 
passively  deflate,  and  recovery  data  was  taken. 

The  goal  of  this  procedure  was  to  investigate  the  role  of 
afferent  signals  upon  motor  outputs.  Consequently  a  detailed 
study  of  altered  sensations  was  not  done  since  it  has 
previously  been  reported  (e.g.  Lewis  et  al,  1937;  Sinclair, 
1951)  that  under  most  conditions  sensation  is  lost  in  the 
following  order*  touch,  position,  temperature,  and  oain.  Our 
subjects  sometimes  reported  numbness  in  the  fingertips,  dulled 
pinprick  sensations,  difficulty  in  knowing  exactly  where  the 
joint  was  without  visual  feedback,  and  the  "pins  and  needles" 
sensations  following  cuff  removal  (Lewis  e^al,  1937).  In  some 
subjects  we  elicited  tendon  tap  responses  before,  during  and 
after  the  ischemia,  in  order  to  verify  the  absence  of  the 
tendon  tap  response  after  ischemia  had  progressed. 

Apparatus  *  The  devices  used  to  move  the  joints  have  been 
previously  described  for  the  ankle  (Agarwal  and  Gottlieb,  1977) 
and  the  wrist  (Jaeger  et  al,  1982).  They  are  shown 
schematically  in  figure  1.  Briefly,  a  torque  motor  was  used  to 
apply  step  or  sinusoidal  torque  waveforms  to  the  joint.  The 


resulting  angular  oosition  and  stretch-evolced  electronvogranhic 
activity  was  monitored.  All  experiments  were  performed  under 
the  control  of  a  real  time  computing  system. 

Sinusoidal  Qacillationt  The  methods  used  and  the  parameter 
estimation  techniques~have  been  described  by  Agarwal  and 
Gottlieb  {1977a,  1977b)  and  Gottlieb  and  Agarwal  (1978). 
Briefly,  sinusoidal  torques  were  applied  to  the  wrist  or  ankle, 
and  the  resulting  joint  angles  were  measured.  The  ratio  of 
the  peak-to'peak  joint  angle  to  peak'-to-paak  torque  amplitudes 
-are  -computed  for- each  of  several- frequencies.  ‘ The  second 
order  fit  is  computed  to  minimize  the  following  error 
criterion: 

Error  -  S  Flo,  ( 

/  |_  \M«Mur«d  oompliknee /J 


In  the  wrist  experiments  a  slight  tapering  of  inout  amplitudes 
was  introduced  to  prevent  excessive  excursion  of  the  wrist  at 
the  lowest  frequencies.  Data  collected  in  this  way  is 
qualitatively  similar  to  data  collected  without  the  taoer, 
except  that  the  wrist  appears  slightly  stiffer  at  low 
frequencies  than  it  actually  is. 

Step  Torque  Perturbation:  The  motor  applied  one- second 
duration  steps  of  torque  to  flex  or  extend  the  joint.  These 
steps  were  typically  randomized  in  amplitude  and  interstep 
interval.  Subjects  were  instructed  to  either  do  nothing  when 
the  step  was  oercieved,  or  react  to  restore  the  joint  to  its' 
starting  position.  Responses  were  grouped  bv  perturbation 
amplitude  and  averaged. 


RESULTS 


Normal  Compliance  Measurements:  Compliance  measurements  were 
made  using  sinusoidal  torque  inputs  over  a  given  frequency 
range  (0.5  to  10.0  hz  for  the  wrist,  3.0  to  12.0  hz  for  the 
ankle) .  These  measurements  typically  showed  an  underdamped 
second  order  response.  Compliance  curves  for  the  wrist  were 
constructed  at  three  different  input  amplitudes  using  five 
different  bias  torques,  and  are  given  in  figure  2.  The 
parameters  J.  B,  and  K  for  these  curves  are  shown  in  table  1. 
The  compliance  measurement  was  very  sensitive  to  input 
amplitude,  and  showed  large  decreases  in  K,  the  stiffness,  as 
larger  amplitude  sinusoidal  torques  were  used.  The  compliance 
measurements  were  also  sensitive  to  bias  torque,  sho'ving 
increases  in  K  with  increasing  bias  torques.  Less  pronounced 
but  consistent  changes  were  seen  in  B,  the  viscosity  term.  The 


Tnoment  of  inertia  was  unchanged.  Similar  results  were  obtained 
for  the  ankle  (Agarwal  and  Gottlieb,  1977a, b).  These 
compliance  measurements  confirm  that  the  biomechanical 
properties  of  the  wrist  joint  determined  in  this  manner  depend 
strongly  on  input  amplitude,  but  remain  reasonably 
approximated  by  a  second  order  system. 

Ischemic  Compliance  Measurement!  Compliance  measurements  were 
made  as  described  in  the  previous  section  while  ischemia  was 

“deveVoping “tn^the  limb.  Figure  3“  shows  three  control-  wrist - 

compliance  curves  and  three  compliance  curves  from  ischemic 
data.  Pitting  a  second  order  linear  model  to  the  data  suggests 
that  both  K  and  B  are  decreasing  to  about  65  oercent  of  their 
control  values,  as  shown  in  table  2.  As  ischemia  develops, 

EMG  activity  normally  evoked  by  i.he  sinusoidal  stretching  was 
reduced  or  abolished.  There  is  some  problem  in  interpretation 
of  these  results,  as  it  takes  six  minutes  to  collect  the  data 
required  to  generate  one  compliance  curve.  During  onset  and 
recovery  of  ischemia,  six  minutes  is  a  significant  period  of 
time.  The  system  changes  over  this  interval,  and  this  must  be 
taken  into  account  when  interpreting  the  data. 

In  more  recent  experiments,  we  have  observed  differences  in 
results  if  we  perform  the  experiments  by  first  collecting  data 
before  ischemia,  allowing  the  limb  to  rest  during  ischemia  up 
to  the  point  when  the  tendon  tap  response  is  abolished,  and 
then  taking  only  one  or  two  sets  of  ischemia  data.  Compliance 
curves  for  the  ankle  for  one  such  experiment  is  given  in 
figure  4,  with  the  second  order  fit  oarameters  given  in  table 
3. 

In  a  second  order  linear  model,  the  decrease  in  K  and  B  as  the 
stretch-evoked  EMG  is  abolished  suggests  that  at  very  low 
frequencies,  a  given  amplitude  of  torque  will  produce  a  qreater 
deflection  of  the  joint,  and  the  resonant  frequency  will  decrease. 

Transient  Responses  -  Normal  versus  Ischemiat  Transient 
responses  to  step  torques  under  normal  and  ischemic  conditions 
were  compared  at  the  wrist  and  the  ankle.  Figure  5  shows  the 
transient  response  of  the  ankle  joint  to  step  torque  and  the 
stretch-evoked  EMG  as  ischemia  develops  in  the  lower  leg.  The 
instruction  to  the  subject  was  "do  not  react"  to  the  torque. 

Note  that  the  final  value  of  joint  anqle  and  the  damping 
increase.  Pnase  plane  trajectories  are  shown  in  figure  6.  Cooke 
(1980)  has  discussed  the  merit  of  observing  the  Phase  plane 
trajectories  of  perturbations  Imposed  on  joint  movements.  Note 
the  behavior  of  the  trajectory  between  110  and  150  ms  as 
ischemia  develops.  In  the  pre-ischemic  trajectories,  the  joint 
begins  to  return  to  its  starting  position,  while  in  the 
ischemic  case  the  joint  comes  to  rest  during  this  time.  The 
additional  overshoot  and  lack  of  oscillation  in  the  Ischemic 
case  c.re  also  seen  in  the  phase  Plane  trajectory.  The  myotatic 
response  occurred  during  the  43-69  ms  interval.  The 
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mechanical  consequences  of  the  myotatic  response  would  not  be 
apparent  until  about  3\d  ms  after  the  SKG. 

One  interpretation  of  these  results  would  than  be  that  the 
myotatic  response  is  in  fact  functional,  and  provides  for  the 
return  of  the  joint  about  30-50  percent  towards  its  startinq 
position,  at  a  latency  appropriate  for  additional  action  by 
subsequent  responses.  While  this  is  most  apparent  at  the  ankle, 
it  is  also  observed  at  the  wrist. 

For  the  instruction  "react  proportionally  to  the  torque",  data 

from  th^  *hXle  jare_  ^hown_in_  figures  _?  and  8. _ Tra  jectories.  are_  — 

similar  to  their  "do  not  react"  counterparts  to  about  150  ms, 
at  which  time  results  of  the  later  stretch-evoked  2MG  are 
apparent  in  fiqure  8,  showing  full  return  to  the  starting 
position . 

At  the  wrist,  responses  for  the  "do  not  react"  instruction 
showed  saturation  (that  is,  movement  to  an  extreme  of  joint 
position  for  a  prolonged  period  of  time)  upon  application  of 
all  but  the  smallest  torque  steps.  The  "do  not  react"  data  were 
therefore  not  included  in  the  analysis.  For  the  react 
instruction,  transient  responses  and  phase  plane  trajectories 
are  shown  in~  figures  9  and  10.  Note  the  differences  in 
trajectories  compared  to  the  ankle.  This  may  be  due  to  the 
fact  that  the  soleua  has  a  verv  strong,  isolated  myotatic 
response,  whereas  the  wrist  has  a  rather  weak  myotatic  response 
which  begins  a  continuum  of  subsequentlv  larger  responses. 

The  responses  as  Ischemia  progresses  show  an  increased 
overshoot  and  a  delayed  return  to  the  original  position.  The 
ischemic  trajectory  begins  to  diverge  from  the  control 
trajectory  at  about  50  ms,  a  time  consistent  with  the  loss  of 
early  stretch  evoked  activitv. 


DISCUSSION 


Changes  In  Mechanical  Properties  with  Ischemia:  In  both  the 
sTnu soida r*and  transient  response  experiments,  changes  in 
•nochanical  properties  were  seen  as  ischemia  developed,  with  the 
concomitant  loss  of  stretch-evoked  5MG  activity.  While 
correspondence  of  EMG  activity  for  the  two  inputs  used  is 
uncertain,  it  is  apparent  that  in  both  cases  it  depends  on 
large  diameter  efferents.  In  the  sinusoidal  case  a  decrease  in 
K  is  Observed  with  ischemia.  Similar  behavior  is  also  seen  in 
the  "do  not  react"  transient  case,  where  a  constant  torque 
produces  larger  steady  state  values  of  joint  angle  as  ischemia 
progresses.  It  appears  that  muscle  becomes  more  compliant 
(less  stiff),  presumably  due  to  reduced  tone,  when  the  spindle 
feedback  is  disrupted  by  ischemia. 

Changes  in  Q  suggest  that  viscous  damping  also  decreases 
during  ischemia.  This  would  suggest  that  greater  velocities  of 
joint  rotation  would  be  reached  during  the  torque 
perturbation.  The  trajectories  of  the  transient  responses 


reflect  this. 

Decreases  in  3  (by  itself)  would  also  imply  more  oscillatory 
behavior  in  the  step  response  but  this  is  not  observed.  The 
changes  in  B  are  too  small  to  show  significant  changes  in  the 
damping  factor. 

Comparing  experiments  in  which  the  muscles  were  active 
throughout  ischemia  with  those  in  which  they  were  rested  has 
led  us  to  explore  the  notion  that  muscle  properties  may  be 
modified  by  at  least  two  mechanismsi  one  of  which  is  associated 
with  observable  changes  in  synchronous  EMG  bursts,  and  -the  - 
other  which  is  not  observable  in  the  EMG. 
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Figure  2>  Wrist  compliance  curves  . 
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Figure  4 t  Compliance  curves  for  the  ankle  before  (x)  and  after 
ischemia  ( • ) .  Joint  angle  and  stretch-evoked  EMG  for  tibialis 
anterior  and  soleua  are  also  shown  in  the  form  of  averages 
computed  over  two  cycles.  Background  is  three  Hz,  foreground  is 
Hz.  Horizontal  scalafi  aro  adjusted  so  that  two  cyclss  are 
displayed  over  the  same  plot  range  for  each  frequency. 
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Figure  5;  Transient  response  at  ankle  joint  foi  "do  not 
react"  instruction.  Soleua  is  stretched  muscle.  Each  trace  is 
the  average  of  10  responses.  Three  torque  step  amplitudes 
were  used.  Control,  mid-ischemia,  and  final  ischemia  data  are 
shown . 
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Fi<^ure  7t  Transient  resoonses  at  the  ankle  for  the  "react 
proportionally"  instruction.  Each  trace  is  the  averaqe  of  ten 
responses.  Four  input  amplitudes  were  used.  Control  and  final 
ischemia  data  shown.  Soleus  muscle  stretched. 
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Fiqure  9s  Transient  resoonses  at  the  wrist  as  isch 
develops.  Each  trace  is  the  averaqe  of  Id  response 
torque  amplitude  was  constant.  Time  from  onset  of 
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Table  1 ;  Second  order  linear  model  parameters  for  normal 

compliance  curves  of  figure  2.  Units;  J  -  newton 'meter* 

second •  second  per  rad,  B  -  newton*  meter*  second  per  rad,  t ’  •  •• 
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0.182 
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0.0070 

0.2254 

CONTROL  2 

1.75 
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0.0016 

0.0073 

0.1965 

CONTROL  3 

1.81 

0.164 

0.0016 

0.0060 

0.2091 

MEAN  CONTROL 

1.81 

0.184 

0.0016 

C.0068 

0.2103 

0.6  MIN  ISCH 

1.89 
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0.0016 

0.0068 
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0.0016 

0.0056 
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24-30  MIN  ISCH 

1.49 
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0.0016 
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0.1404 

Table  2 ;  Second  order  linear  model  parameters  for  the 
compliance  curves  in  figure  3. 


97 


CONTROL 


51.883 


ISCHEMIA 


5.40  0.147  0.0453  0.451 

6.00  0.188  0.0440  0.621  62.012 


Table  3 1  Second  order  linear  model  parameters  for  the  normal 
compliance  curves  of  figure  4. 
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As  part  of  the  process  of  quantifying  human/machine  performance 
and  interaction,  it  would  be  useful  to  have  a  noninvasive 
nonsubjective  measure  with  which  to  assess  aspects  of  human 
functioning  such  as  attention,  capacity,  stress,  etc.  The 
Visually  Evoked  Response  (VER)  E£G  possesses  qualities  that 
suggest  it  may  be  such  a  useful  measure.  The  human  does  not 
have  to  consciously  attend  to  the  evoking  stimulus  and  the 
response  may  be  independent  of  human  subjectivity.  Further, 
it  has  become  fairly  routine  to  obtain  EEC's  due  to  improve¬ 
ments  in  measurement  techniques  and  signal  averaging  computer 
technology.  Of  course,  once  the  EEG  is  obtained,  the  real 
problem  remains,  one  of  answering  the  following  questions: 
what  does  it  indicate,  is  it  in  response  to  the  visually 
evoking  stimulus,  is  it  repeatable,  is  there  a  linear  portion 
to  the  response,  is  it  consistent  across  subjects,  etc.  At  the 
Aerospace  Medical  Research  Laboratory  we  have  undertaken  a 
research  program  to  explore  the  usefulness  of  the  steady  state 
VER  and  see  what  questions  we  can  answer.  To  control  the 
human's  "internal  environment"  while  making  VER  measurements , 
we  are  employing  a  supervisory  decision-making  task  as  devel¬ 
oped  by  Pattipati  and  Kleinman  at  the  University  of  Conneticut. 
The  experimental  configuration  consists  of  humans  performing 
the  decision  task  which  is  displayed  on  a  centrally  located 
five-inch  diagonal  TV  monitor  while  two  fluorescent  flash 
tubes  above  and  below  the  monitor  provide  the  visually  evoking 
stimulus.  At  this  time,  some  pilot  studies  have  been  per¬ 
formed.  In  this  paper  the  experimental  setup  will  be  dis¬ 
cussed,  and  decision-making  performance  results  along  with 
some  of  the  potentially  useful  features  observed  in  the  EEG 
response  will  be  presented. 
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ABSTRACT 

— ^  While  the  processing  demands  of  second  order  manual  control  are  known  to 
be  greater  than  those  of  1st  or  0  order,  the  precise  nature  or  locus  of  these 
Increased  demands  Is  not  well  established.  The  purpose  of  this  research  Is 
to  determine  If  the  demands  are  perceptualT?related  to  the  perception  of 
higher  derivatives  of  the  error  signal  or  ^aracterl sties  of  the  system  state, 
and  thereby  fluctuating  with  changes  In  these  varlablesVor  central.  In  the 
latter  case,  we  assume  the  demand  to  be  constant  over  tme,  a  consequence  of 
the  Increased  demands  of  activating  a  more  complex  Internal  model.  Events 
related  brain  potentialTi--  more  specifically,  P300  amplitude  --  were  employed 
to  assess  operator  workload  while  controlling  a  second  order  system.  The  ERP 
waveforms  were  categorized  according  to  the  system  state  at  the  time  of  the 
eliciting  probes.  Statistical  analyses  revealed  no  differences  In  P300 
amplitude  among  the  categories.  Thus.  It  was  concluded  that  the  Increased 
level  of  operator  workload  remained  constant  rather  than  fluctuating  with 
changes  In  the  system  state.  These  results  Identify  central  processing 
rather  than  perception  as  the  locus  of  higher  order  load. 

INTRODUCTION  ^ 

The  difficulty  In  manually  controlling  higher  order  systems  has  long 
been  recognized  (1,  2,  3).  The  basis  for  this  Inherent  difficulty  may  be 
attributed  to  several  different  sources.  For  example,  the  operator  of  a 
higher  order  system  must  act  as  a  differentiator,  generating  lead  In  response 
to  the  perceived  error  signal;  also  there  exists  greater  uncertainty  In 
control  because  the  required  control  Input  Is  not  a  one-to-one  mapping  of 
system  error.  Thirdly,  double  Impulse  control  of  second  order  systems 
requires  a  greater  demand  for  accurate  measurement  of  timing.  The  potential 
source  of  Increased  demand  relevant  to  this  research  relates  to  the  fact  that 
the  controller  of  higher  order  systems  must  perceive  a  greater  number  of 
system  states  and  then  combine  them  via  a  more  complex  Internal  model  (2,  3, 


4).  For  example,  in  order  to  optimally  control  a  second  order  system,  the 
operator  must  estimate  both  position  and  velocity,  and  then  combine  them  via 
the  Internal  mode!  to  determine  the  appropriate  control  Input. 

Furthermore,  this  Increased  difficulty  In  controlling  higher  order 
systems  has  also  been  shown,  as  would  be  expected,  to  result  In  greater 
operator  workload  (5,  6).  More  specifically,  these  Investigations  have 
suggested  that  the  locus  of  this  Increased  workload  has  been  shown  to  reside 
In  the  perceptual  and  central  processing  stages  of  the  operator  and  not  In  the 
response  stage.  The  fundamental  Issue  addressed  In  the  present  research 
concerns  the  temporal  nature  of  this  Increased  workload  and  the  precise 
localization  between  perception  and  central  processing.  We  hypothesize  that 
If  the  source  of  higher  workload  relates  to  problems  encountered  In  perceiving 
higher  derivatives  of  the  error  signal,  or  particular  combinations  of  state 
variables  from  the  display,  then  workload  should  vary  from  moment  to  moment  as 
a  function  of  those  variables.  If,  on  the  other  hand,  the  source  Is  attri¬ 
buted  to  the  requirement  to  activate  and  maintain  a  more  compl  >x  Internal 
model  In  working  memory,  we  anticipate  that  these  Increased  d'jnands  will  be 
more  stable  and  constant  for  the  duration  of  the  tracking  tr'al. 

In  this  research,  event  related  brain  potentials  (ERPs)  were  used  to 
assess  changes  In  operator  workload.  The  ERP  Is  a  transient  series  of  voltage 
fluctuations  In  the  brain  in  response  to  some  discrete  stimulus  or  cognitive 
event.  ERPs  are  recorded  by  the  use  of  skin  electrodes  which  are  located  at 
specific  sites  on  the  scalp.  By  time  locking  the  EEG  recording  to  a  discrete 
eliciting  stimulus  event  and  then  ensemble  averaging,  a  very  consistent 
pattern  of  positive  and  negative  peaks  or  components  will  be  observed  (7). 
Extensive  research  has  shown  the  amplitude  of  the  P300  component  to  be 
inversely  proportional  to  the  operator's  perceptual  and  central  processing 
workload  (5,  7,  8).  P300  amplitude  was  used  as  a  dependent  measure  of 
operator  workload  in  the  research  described  below. 

EXPERIMENT 


Five  subjects  were  recruited  from  the  university  community  and  paid  for 
their  services.  Their  primary  task  was  to  minimize  the  RMS  tracking  error  of 
a  pure  second  order  system  In  the  presence  of  random  noise.  System  error  was 
displayed  on  a  CRT  (HP  model  3010)  and  control  Inputs  were  made  with  the  right 
hand  via  a  spring  loaded  Joystick.  All  subjects  were  requested  to  use  a  bang- 
bang  or  double-impulse  control  strategy  (3)  as  such  a  strategy  was  essential 
for  later  analyses. 

The  experiment  was  conducted  In  two  phases:  Phase  1  -  Training,  and 
Phase  2  -  Data  Collection.  The  primary  purpose  of  Phase  1  was  to  train  sub¬ 
jects  until  they  reached  asymptotic  performance.  It  consisted  of  50  two- 
minute  tracking  trials,  25  trials  per  day  for  two  consecutive  days.  Phase  2 
was  conducted  on  the  third  day  during  which  subjects  participated  In  20  two- 
minute  tracking  trials.  In  addition  to  performing  the  primary  tracking  task, 
subjects  were  also  required  to  perform  a  secondary  task  of  counting  discrete 
auditory  tones  or  probes.  The  purpose  of  these  probes  was  to  provide  the 
discrete  event  for  eliciting  the  ERPs.  They  were  presented,  via  headphones. 

In  a  Bernoulli  series  of  low  (P  »  .33)  and  high  (P  ■  .67)  Intensity.  The 
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subject's  task  was  to  maintain  a  covert  mental  count  of  the  number  of  low 
intensity  probes  presented  and  report  this  count  at  the  end  of  each  block. 

ANALYSIS  AND  RESULTS 


Each  ERP  waveform  was  selectively  tagged  according  to  the  momentary 
state  (error,  error  velocity,  control  position,  control  velocity)  at  the  time 
of  stimulus  presentation.  This  enabled  us  to  create  selective  averages  of 
ERPs  (with  their  associated  P300  component  amplitudes)  according  to  any 
particular  characteristics  of  system  state.  Two  separate  analyses  were  per¬ 
formed:  one  based  solely  upon  system  error  and  error  velocity,  each  consid¬ 
ered  Independently,  and  the  other  based  upon  a  state-space  representation. 

Analysis  1 : 

Two  dichotonr'es  were  employed  to  categorize  ERPs,  one  based  upon  system 
error,  and  one  upon  system  velocity.  All  waveforms  were  ordered  in  terms  of 
the  absolute  value  of  system  error  at  the  time  of  the  eliciting  stimulus. 

Then  waveforms  above  and  below  the  median  of  this  ordering  were  separately 
pooled  and  contrasted.  A  similar  procedure  was  followed  with  regard  to 
system  error  velocity. 

A  separate  ANOVA  was  performed  on  the  component  loading  scores,  from  the 
PCA,  for  each  of  the  dichotomies.  That  Is,  P300  amplitude  (as  measured  by 
its  component  loading  score)  elicited  from  probes  when  the  absolute  value  of 
system  error  was  above  its  median  value  was  compared  with  the  P300  amplitude 
when  system  error  was  below  its  median  value.  Similarly,  the  same  comparison 
was  made  for  the  case  when  absolute  system  velocity  was  above  and  below  the 
median  value. 

For  both  comparisons  the  results  were  the  same,  with  no  significant 
difference  between  high  and  low  values.  That  is  to  say  operator  workload  (as 
measured  by  P300  amplitude)  did  not  vary  in  a  systematic  manner  with  the 
error  variables.  These  results  are  consistent  with  our  previous  findings  (5) 

Analysis  2: 

The  rationale  for  the  second  analysis  is  based  upon  the  subjects'  employ 
ment  of  a  bang-bang  control  strategy.  Such  a  strategy  requires  the  operator 
to  maintain  the  maximum  positive  control  input  when  attempting  to  eliminate  a 
given  error  and  then  at  the  proper  instant  (as  specified  by  an  analytically 
determined  optimal  switching  line)  reverse  the  input  to  its  maximum  negative 
value,  a  relatively  natural  strategy  often  employed  in  2nd  order  control  (2). 

If  operator  workload  were  to  fluctuate  during  such  a  task,  it  is  clear 
that  it  would  be  the  greatest  when  the  system  state  was  in  the  "vicinity"  of 
the  operator's  empirical  switching  line  when  a  decision  to  control  is 
impending.  That  is,  workload  would  be  higher  when  the  operator  was  required 
to:  (1)  perceive  the  magnitude  of  the  system  error;  (2)  perceive  the  magni¬ 
tude  of  the  system  velocity;  (3)  combine  them  via  his  internal  model;  and  (4) 
decide  if  a  control  reversal  was  required.  Alternatively,  the  workload  would 
be  lower  when  the  system  state  was  such  that  the  control  input  was  obvious. 


For  example,  when  system  error  and  velocity  are  both  of  the  same  sign,  a 
control  reversal  Is  obviously  required  since  error  Is  diverging.  In  short, 
the  objective  of  the  second  set  of  analyses  was  to  compare  operator  workload 
when  the  system  state  was  In  the  vicinity  of  the  operator's  empirical 
switching  .Ine  to  that  when  the  required  control  Input,  was  obvious. 

An  algorithm  was  developed  that  analyzed  the  subject's  continuous 
control  Input  and  Identified  the  system  state  at  the  time  each  control 
reversal  was  Initiated.  The  locus  of  these  control  reversals  was  defined  to 
be  the  "vicinity"  of  the  subject's  empirical  switching  line.  Figure  1  Is  a 
graphical  representation  of  the  system  state  space  on  which  these  control 
reversals  are  plotted  for  a  typical  subject,  along  with  the  theoretically 
optimal  switching  line.  After  reviewing  such  plots  for  each  subject,  it  was 
concluded  that  the  general  locus  of  control  reversals  for  each  subject  was 
sufficiently  similar  that  the  same  ERP  categorization  algorithm  could  be  used 
for  all  subjects. 

This  algorithm  Is  Illustrated  graphically  In  Figure  2.  The  rationale 
for  each  area  Is  discussed  below. 

Area  1 .  This  represents  the  region  In  the  vicinity  of  the  subject's 
empirical  switching  line.  The  boundaries  were  chosen  conservatively  to 
select  probes  that  occurred  when  the  system  state  was  such  that  the  operator 
would  be  required  to  sense  both  position  and'  velocity,  and  then  combine  them 
(via  his  Internal  model)  to  determine  the  proper  control  Input.  This  was 
assumed  to  be  the  area  defining  a  state  of  greatest  cognitive  demands. 

Area  2.  This  region  represents  a  conservative  selection  of  probes  when 
the  state  was  such  that  the  subject's  control  Input  was  obvious;  that  Is, 
when  the  cursor  was  moving  away  from  the  target  line.  The  response  in  this 
region  should  be  a  relatively  automatic  reversal. 

Area  3.  This  represents  a  system  state  similar  to  Area  1,  but  In  which 
the  velocity,  relative  to  the  position,  is  too  low  to  warrant  a  control 
reversal.  This  Is,  the  cursor  Is  moving  towards  the  target  line,  but  not 
fast  enough  to  warrant  a  control  reversal  to  prevent  overshoot. 

Area  4.  This  region  Is  comprised  of  the  remainder  of  the  system  state 
space  wh'lch  falls  to  meet  the  requirements  of  any  of  the  preceding  areas. 

Areas  1  and  2  were  defined  In  a  conservative  manner  in  order  to  maximize 
the  potential  differences  between  the  two,  thereby  Increasing  the  sensitivity 
of  the  subsequent  analyses.  Area  3  was  selected  to  provide  a  condition  In 
which  workload.  If  workload  does  Indeed  fluctuate,  would  lie  between  that  of 
Areas  1  and  2. 

This  sorting  algorithm  was  applied  to  the  single  trial  ERP  data  of  each 
subject.  Initially,  the  parameters  were  chosen  very  liberally,  such  that 
Area  4  was  non-existent.  The  resultant  ERPs  from  the  three  areas  were  then 
averaged  across  subjects.  As  before,  an  ANOVA  was  performed  on  the  component 
loading  scores  for  P300;  no  significant  differences  were  observed.  In  order 
to  Increase  the  sensitivity  of  the  test,  subsequent  analyses  were  done  in 


which  the  boundaries  of  Area  4  were  systematically  expanded  by  decreasing  the 
parameter  A,  (see  figure  2).  That  Is,  Areas  1  and  2  were  defined  in  an 
increasingly  conservative  manner.  The  results  remained  unchanged,  however, 
as  no  differences  emerged  with  this  manipulation. 

CONCLUSIONS 


The  results  of  these  two  separate  analyses  were  consistent.  No  matter 
whether  ERP  data  were  categorized  via  the  magnitude  of  each  state  variable, 
relative  to  the  mean,  or  whether  the  categorization  was  based  on  the  location 
of -the  system  state  relative  to  the  empirical  switching_l1ne,  differences  in  _ 
P300  amplitude  between  categorical  levels  failed  to  be  observed.  In  fact, 
there  were  not  even  nonsignificant  trends  in  this  direction.  These  results 
provide  strong  support  for  the  hypothesis  that  the  increased  resource  demands 
of  controlling  second  order  systems  remain  relatively  constant. 

They  are,  of  course,  consistent  with  the  hypothesis  that  it  is  the 
continuous  demands  of  activating  the  complex  internal  model,  rather  than  the 
momentary  demands  associated  with  changing  perceptual  variables  that 
influence  workload.  There  is,  however,  a  second  possibility  that  cannot  be 
discounted  altogether.  It  is  possible  that  resource  demand  of  control  did,  in 
fact,  wax  and  wane,  but  that  the  "cost"  associated  with  switching  the 
allocation  of  resources  to  the  auditory  task  was  greater  than  the  benefits 
derived.  That  is,  it  was  more  efficient  to  allocate  a  given  amount  of 
resources  continuously  to  the  tracking  task,  even  though  they  would  not  all  be 
used  low  of  the  time,  than  it  was  to  vary  the  allocation  of  resources  based 
on  the  instantaneous  task  demands.  (It  should  be  noted  in  this  regard  that, 
while  P300  was  consistently  attenuated,  subjects  did  not  ignore  the  tone 
counting.  Their  counts  remained  accurate.)  It  is  impossible  to  determine 
from  the  current  data  which  of  the  two  hypotheses  is  correct.  To  do  so  would 
require  running  an  additional  condition  in  which  greater  priorities  on  the 
auditory  task  are  stressed.  When  payoffs  or  costs  thereby  impel 1  the  operator 
to  devote  greater  resources  to  the  ERP  task,  we  would  noiw expect  differential 
allocation  (and  therefore  P300  amplitude)  to  the  extent  that  the  second 
hypothesis  was  in  effect.  If  the  first  hypothesis  were  true,  we  would  predict 
an  overall  depression  in  tracking  performance  and  an  increase  in  P300  ampli¬ 
tude,  as  the  internal  model  was  maintained  with  less  fidelity.  However,  P300 
would  still  fail  to  discriminate  between  system  states. 
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ABSTRACT 


ASSESSMENT  OF  MANUAL,  PROCESS  CONTROL  STRATEGIES 


by 

Joe  Oe  Maio 

Air  Force  Human  Resources  Laboratory 
Operations  Training  Division 
Williams  AF3.  AZ  85224 


-s^e  present  research  is  directed  at  developing  a  methodology  for 
examining  Individuals'  performance  as  process  controllers.  The  process  of 
inmediate  Interest  is  maneuvering  flight.  In  this  task  the  pilot  performs 
as  an  energy  management  decision  maker,  making  moment  by  moment  decisions 
regarding  present  and  future  aircraft  energv  states.  A  microj5oiwputer»-based 
task  has  been  developed  in  which  a  subject  •flies''  a  simulated  "vehicle' 
through  a  course  in  a  sequence  of  discrete  moves.  The  range  of  movement 
available  on  each  move  is  determined  by  generic,  aircraft  flight  equations. 
Performance,  as  Indexed  by  number  of  moves  required  to  complete  the  course, 
has  been  found  to  be  strongly  related  to  flying  ability.  Additional 
performance  measures,  based  on  the  decisions  made  on  each  move,  have  been 
developed  which  permit  examination  of  control  strategies  underlying  task 
performance.  Such  measures  will  permit  analysis  of  cognitive  functions 
leading  to  successful  control  performance  and  of  the  effects  of 
environmental  and  individual  factors  on  these  decision  making  functions. 


INTRODUCTION 


A  number  of  vehicle  control  tasks  involve  maintaining  some  predetermined 
steady  state.  Driving  an  automobile  on  a  straight  road,  steering  a  ship  on 
a  constant  heading  and  flying  an  aircraft  at  constant  heading  and  climb  rate 
are  exwples  of  such  tasks.  In  these  types  of  tasks  the  operator's  function 
is  primarily  one  of  detecting  error,  In  the  form  of  deviations  from  the 
desired  motion  path,  and  correcting  that  error.  For  the  most  part  the 
operator  acts  as  a  single  closed-loop  controller  whose  performance  is 
determined  primarily  by  his  sensitivity  to  error  and  his  control  lag. 
(Jagacinski,  1977). 


In  a  number  of  other  tasks  the  operator's  role  is  much  more  complex.  He 
does  not  seek  simply  to  maintain  a  steady  state,  but  rather  his  goal  is  to 
achieve  a  particular  vehicle  state  through  execution  of  a  sequential  process 
of  velocity  changes.  In  these  tasks  the  operator’s  actions  are  directed 
toward  the  goal  state,  which  differs  from  his  current  state  and  from 
intermediate  states.  Intermediate  vehicle  states  are  important  only  insofar 
as  they  affect  the  ultimate  vehicle  state.  Task  sequences  can  be  relatively 
short  and  uncomplicated,  as  in  parallel  parking  a  car,  or  quite  long  and 
complicated,  as  in  the  case  of  driving  home  in  rush  hour  traffic  in  time  to 
see  the  news  on  TV.  In  these  instances  the  operator's  performance  is 


determined  both  by  his  interface  with  the  vehicle  and  by  his  performance  as 
an  information  processor  and  decision  maker. 

Describing  performance  on  these  task  sequences  is  complicated  by  the 
sheer  number  of  control  actions  involved  and  by  the  fact  that  the  optimum 
action  a  given  point  in  the  sequence  is  determined  by  earlier  events  both 
internal  to  the  operator- vehicle  system  and  external  to  it.  For  example  the 
decision  on  whether  to  turn  right  at  an  Intersection  in  order  to  get  home  by 
news  time  can  depend  on  whether  the  vehicle  will  reach  the  intersection 
while  the  signal  is  green  (Internal,  speed  control),  how  long  the  red  will 
last  and  how  well  traffic  is  moving  on  the  two  streets  (external).  The 
operator  steers  the  vehicle  according  to  a  goal -directed  scenario  which  he 
updates  continuously  in  response  to  changing  conditions.  The  correctness  of 
any  paticular  control  action  in  the  sequence  is  determined  by  two  factors: 
the  correctness  of  the  scenario  and  the  appropriateness  of  the  control 
action  to  the  scenario. 

At  a  macro  level  vehicular  motion  scenarios  are  very  similar  to 
scripts.  A  script  is  a  set  of  related  facts  which  is  organized 
hierarchically  and  sequentially  (Smith,  Adams  and  Schorr,  1978).  In  the 
motion  scenario  facts  might  be  events  or  control  actions  which  are  organized 
by  the  importance  or  probability  of  occurrences  at  particular  points  in  the 
process.  Schvaneveldt  et  a1  (in  press)  have  shown  experienced  fighter 
pilots  to  organize  major  events  and  actions  related  to  particular  maneuvers 
in  this  way.  Facts  in  these  scripts  are  aircraft  states,  pilot  actions,  the 
effects  of  these  actions,  controls  and  instruments,  and  the  actions  of  other 
combatants.  These  facts  are  organized  primarily  along  a  dimension  of 
temporal  criticality  and  secondarilty  along  a  dimension  of  relative  energy 
state. 

At  a  finer  level  of  detail,  involving  individual  control  inputs,  vehicle 
control  can  be  thought  of  as  a  similar  sequential  process  of  goal  directed 
decisions  and  control  actions.  While  the  second  by  second  control  process 
may  involve  a  sequence  of  decision  events,  it  is  less  well  suited  to  a 
scripts  type  analysis  since  decisions  occur  rapidly  and  may  be  based  on 
information  which  is  not  organized  semantically.  This  micro  control  process 
is  similar  to  closed-loop  tracking,  but  unlike  tracking  it  consists  of  a 
sequence  of  actions  directed  at  establishing  a  particular  state  rather  than 
at  simply  minimizing  error.  In  this  control  process  several  different 
control  actions  might  be  effective  in  achieving  the  desired  state.  The 
operator's  decision  about  which  actions  to  employ  may  depend  on  many 
factors,  such  as  the  degree  and  direction  of  motion  required,  the 
probability  of  success  and  the  cost  of  failure  associated  with  a  particular 
control  action  sequence.  In  the  real  time  motion  control  task  it  is 
difficult  to  isolate  the  micro-decision  making  process  from  perceptual  and 
psychomotor  factors.  If,  for  instance,  a  pilot  ends  up  with  excessive 
airspeed  on  final,  it  is  not  possible  to  know  whether  the  error  arose  from 
the  pilot's  failure  to  perceive  the  airspeed  buildup  or  from  an  inability  to 
make  the  appropriate  control  Inputs  or  whether  he  saw  what  was  happening  and 
decided  that  everything  was  just  fine. 

One  approach  to  isolating  the  micro-decision  making  process  is  to 
present  subjects  a  discrete-time  vehicle  control  task.  In  this  task  the 
subject  "steers"  a  computerized  vehicle  through  a  course  in  a  sequence  of 


inoves.  On  each  move  the  motion  envelop  is  determined  by  the  vehicle  state 
at  the  end  of  the  preceding  move  through  a  set  of  driving  equations.  The 
task  is  self-paced,  and  the  subject  types  the  move  he  desires  on  a 
keyboard.  Oe  Maio  (1981)  compared  the  performance  of  Air  Force  pilots  and 
that  of  non-pilots  on  a  discrete-time  task  in  which  subjects  controlled 
vehicular  movement  by  adjusting  the  length  of  two  perpendicular  driving 
vectors.  As  indexed  by  the  number  of  moves  required  to  complete  the  course, 
the  pilot  group  performed  better  than  the  non-pilot  group.  The  pilots  also 
made  longer  moves  on  the  average,  although  the  average  total  track  length 
was  the  same  for  both  groups. 

In  the  present  research  a  discrete-time  vehicle  control  task  is  used  in 
which  the  driving  equations  more  closely  approximate  those  of  an  actual 
vehicle.  Performance  on  individual  moves  is  examined  to  determine  the 
decision  making  process  leading  to  superior  task  performance. 

METHOD 


Subjects 


Twenty-three  subjects  were  used.  Eight  of  these  were  students  in 
Undergraduate  Pilot  Training  (UPT)  at  Williams  AFB.  Four  had  recently 
completed  UPT.  Eleven  were  civilian  employees  at  the  Human  Resources 
Laboratory,  who  had  no  flying  experience. 


Apparatus 

The  Flight  Decision-making  Assessment  Task  (FDAT)  is  a  discrete-time 
vehicle  control  task  programmed  on'  a  Terak  8510M  micro-computer.  The  FDAT 
involves  "steering"  a  vehicle  through  a  winding  course  in  a  series  of 
moves.  The  subjects'  task  was  to  traverse  the  course  in  as  few  moves  as 
possible.  The  subject  makes  a  move  by  entering  two  numbers.  The  first 
number  entered  is  the  amount  of  heading  change  desired,  in  degrees. 

Following  this  input  the  vehicle's  velocity  is  decremented  in  proportion  to 
the  amount  of  heading  change  by  an  "induced  drag"  function.  A  thrust/drag 
function  then  determines  the  amount  the  subject  may  increase  or  decrease  his 
velocity.  The  subject  completes  the  move  by  entering  the  velocity  desired, 
that  is  the  length  of  the  move.  The  ground  track  is  then  displayed  on  the 
course,  and  the  new  heading  and  velocity  and  associated  maximum  heading 
change  and  maximum  induced  drag  penalty  are  shown. 

The  FDAT  driving  functions  are  generic  flight  equations  for  an  aircraft 
constrained  to  level  flight  and  zero  angle  of  attack  and  scaled  to  fit  on 
the  320  x  240  Terak  graphics  screen.  The  three  functions  which  determine 
vehicle  performance  are:  maximum  heading  change,  induced  drag  velocity 
penalty,  minimum/maximum  velocity  change. 

A  complete  listing  of  the  vehicle  perrformance  limits  is  given  in  Table 
1.  The  "stall"  or  minimum  velocity  is  7  units,  and  the  maximum  velocity  is 
28  units.  Velocity  units  are  pixels.  The  course  lengths  are  roughly  680 
pixels.  The  maximum  allowable  heading  change  reached  a  minimum  of  13°  at 
stall  and  23°  at  maximum  velocity  and  a  maximum  of  48°  at  the  14  unit 
corner  velocity. 
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Procedure 


The  subject  sat  before  the  computer  terminal  with  the  experimenter 
seated  at  his  left.  The  experimenter  explained  that  the  purpose  of  the 
research  was  to  examine  the  decision  making  process  associate  with  aircraft 
control.  The  experimenter  then  made  four  demonstration  moves  showing 
turning,  acceleration  and  the  effect  of  trying  to  exit  the  course 
boundaries.  The  subject  then  completed  two  courses,  always  performing  the 
easier  course  first.  The  experimenter  was  present  throughout  the  session. 
The  subject  was  allowed  to  ask  questions,  but  questions  about  strategies 
were  not  answered. 

RESULTS 

Overall  Performance 

Overall  FOAT  performance  was  given  by  the  number  of  moves  required  to 
traverse  each  course.  For  the  entire  sample  of  subjects  number  of  moves 
varied  from  38  to  75  for  Course  1  and  from  40  to  87  for  Course  2.  One 
subject  (the  experimenter)  was  highly  practiced  at  the  FDAT.  Discounting 
this  subject  the  range  was  44  to  75  for  Course  1  and  50  to  87  for  Course  2. 
There  were  no  significant  differences  In  overall  performance  between  groups. 

Internal  Performance  Analysis 

Task  requirements  and  the  vehicles  handling  qualities  placed  a  high 
premium  on  maintaining  a  velocity  equal  to  or  greater  than  14  units.  Due  to 
the  vehicles'  low  thrust/drag  ratio  it  was  not  possible  to  sustain  speed 
during  intense  cornering.  As  a  result  the  subject  needed  to  position 
himself  on  the  course  in  such  a  manner  as  to  permit  acceleration  and  to  time 
turns  to  minimumize  heading  changes  and  resultant  loss  of  velocity.  Speed 
control  and  timing  errors  were  easily  Identifiable  by  visual  Inspection  of 
individual  moves  and  move  sequences.  In  order  to  quantify  speed  control, 
velocity  control  and  timing  performance  four  categories  of  moves  were 
defined: 

Velocity  control 

Extending  moves  -  5®  turn  accelerating 

Stagnating  moves  -  92  units  deceleration  or 

velocity  < 10  units 

Turning  control 

Sustained  turn  moves  -  50-30°  in  constant  d1 ret  ion, 

roughly  constant  velocity 
Positioning  moves  -  50-30°  only  one  move 

^5°  turn  with  0-1  unit  deceleration 

Velocity  control  performance  was  given  by  the  ratio  of  the  number  of 
extending  moves  to  the  number  of  stagnating  moves.  A  measure  of  turning 
control  performance  was  the  ratio  of  the  number  of  sustained  turn  moves  to 
the  number  of  positioning  moves.  A  measure  of  timing  was  the  total  amount 


of  heading  change  regardless  of  direction,  since  on  some,  but  not  all, 
turns,  mistiming  necessitated  corrective  turns  which  Increased  the  total 
heading  change  for  the  course. 

In  order  to  determine  the  contribution  of  speed  control  performance, 
turning  control  performance  and  timing  performance  to  overall  performance  a 
multiple  regression  of  the  two  ratios  and  the  total  heading  change  on  number 
of  moves  for  Course  1  and  for  Course  2  separately. 

For  Course  1  all  three  Internal  performance  measures  contributed 
significantly  to  overall  performance  (see  Table  2).  The  primary  driver  of 
performance  was  speed  control.  Timing,  as  measured  by  total  heading  change, 
also  contribute  substantially  to  overall  performance.  The  ratio  of 
sustained  turn  to  positioning  moves  measures  the  smoothness  of  heading 
control  and  made  only  a  small  contribution  to  overall  performance. 

The  results  of  the  regression  analysis  for  Course  2  differed 
substantially  from  those  for  Course  1  (see  Table2).  Speed  control 
performance  accounted  for  over  85X  of  the  variance  In  overall  performance. 
Neither  of  the  turn  timing  measures  contributed  to  overall  performance.  The 
differing  results  for  the  two  courses  probably  stems  from  a  design  flaw  In 
Course  2.  Course  2  contained  3  turns  (out  of  6)  In  which  it  was  impossible 
or  nearly  Impossible  to  avoid  complete  velocity  stagnation.  As  a  result 
speed  control  was  nore  highly  correlated  with  both  overall  performance  and 
with  turn  timing  performance  on  Course  2  than  on  Course  1  (see  Table  3).  In 
addition  a  much  greater  proportion  of  moves  was  related  to  speed  control  on 
Course  2  than  on  Course  1  Uee  Table  4). 


DISCUSSION 

The  present  work  Is  based  on  the  Idea  that  the  process  of  steering  a 
vehicle  from  an  Initial  energy-position  state  to  a  goal  energy-position 
state  can  be  described  as  a  sequence  of  vehicle  control  decisions.  Success 
In  achieving  the  desired  state  will  be  a  function  of  the  quality  of  the 
control  decisions  made  during  the  process  sequence. 

The  Flight  Decision-making  Assessment  Task  used  In  this  work  is  a 
discrete-time  vehicle  control  task  in  which  subjects  are  required  to  make  a 
sequence  of  decisions  regarding  three  aspects  of  vehicle  control;  velocity 
control,  turning  control  and  timing  of  turns.  By  examining  Internal 
performance  Indicators  which  tap  these  decision  making  functions,  it  Is 
possible  to  quantify  these  decision  functions  and  also  to  assess  the 
relative  Importance  of  the  decision  making  processes  to  overall  task 
performance.  The  present  results  show  that  overall  performance  can  be 
described  by  a  linear  combination  of  speed  control,  turning  control  and  turn 
timing  performance.  When  the  FDAT  course  was  well  designed,  as  In  Course  1, 
the  contribution  of  speed  control  In  the  regression  accounted  for  37*  of  the 
variance  1n  overall  performance.  The  contribution  of  turn  timing,  as 
Indexed  by  total  turn,  accounted  for  27X  of  the  variance  in  overall 
performance.  Turning  smoothness,  as  Indexed  by  the  ratio  of  sustained  turn 
to  positioning  moves,  had  the  smallest  contribution  to  overall  performance, 
accounting  for  isi  of  the  overall  performance  variance.  However  care  must 
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be  used  1n  designing  d1screte>t1me  tasks  to  Insure  that  there  Is  sufficient 
Independence  In  the  effects  of  the  decision  processes  to  permit  analysis  of 
Individual  decision  components.  On  Course  2  only  speed  control  affected 
overall  performance.  This  was  probably  due  to  the  high  proportion  of 
stagnated  moves  on  Course  2. 

The  ability  to  Investigate  Individual  decision  process  can  be  use  to 
gain  greater  Insight  Into  the  cognitive  demands  of  vehicle  control  tasks. 

By  varying  task  requirements,  vehicle  control  dynamics  or  course  design.  It 
may  be  possible  to  change  the  relative  Importance  of  different  decision 
components  In  determining  overall  task  performance  or  the  difficulty  of 
making  these  dec1s1ons_.  An  additional  area  of  study,  which- has  not  been- 
addressedlnthe  present  work  Is  decision  making  speed.  The  discrete-time 
methodolgy  can  provide  a  powerful  tool  for  studying  this  problem  by 
permitting  the  unconfounding  of  effects  arising  from  requirements  for 
speeded  perception  and  speeded  responding,  and  those  arising  from  the 
decision  making  process. 


Velocity 

Maximum 

Heading 

Change, 

Degrees 

Maximum 

Induced 

Drag  Penalty 

Velocity  Change 
Minimum  1 

Maximum 

7 

13 

0 

0 

1 

8 

19 

-1 

-1 

2 

9 

24 

-2 

-1 

3 

10 

27 

-3 

-1 

4 

11 

30 

-4 

-2 

4 

12 

33 

-5 

-2 

4 

13 

36 

-6 

-2 

4 

14 

48 

.7 

-2 

4 

15 

44 

-7 

-2 

4 

16 

42 

>8 

-2 

4 

17 

39 

-8 

-2 

4 

18 

37 

-8 

-2 

4 

19 

35 

-8 

-3 

3 

20 

33 

-9 

-3 

3 

21 

32 

•9 

-3 

3 

22 

30 

-9 

-3 

2 

23 

29 

-9 

-3 

2 

24 

28 

-10 

-4 

1 

25 

27 

-10 

-4 

1 

26 

26 

-10 

-4 

1 

27 

25 

-10 

-4 

0 

Table  1 

Vehicle  performance  limits  at  each  velocity.  Performance  Is  optima!  around 
the  corner  velocity  of  14. 


Factor 

Beta-weight 

Course  1 

Beta-weight 
Course  2 

Ext/Stag 

-.46  * 

-.93  * 

SUS/POS 

-.27  * 

NS 

TOT  TURN 

-.38  * 

NS 

R 

*  p  <.001 

.89* 

.93* 

Table  2 

Multiple  regression  analysis  Internal  performance  measures  on  overall 
performance 


OVERALL 


EXT/STAG 


SUS/POS 


TOT  TURN 


OVERALL 

EXT/STAG 

-.79  (-.93) 

- 

SUS/POS 

-.55  (-.57) 

.39  (.46) 

- 

TOT  TURN 

.72  (.69) 

-.59  (-.77) 

-.24  ( 

TABLE  3 

Individual  correlations  between  internal  performance  variables 
and  overall  performance.  Course  2  shown  In  (). 
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urn 


SUSTAINED  TURN 

POSITIONING 

EXTENDING 

STAGNATING 

CSmfli 

f*' ••  ■  • . 

»  *  •  •  * 

Course  1 

.22  (.17) 

.14  (.10) 

.32  (.11) 

.33  (.20) 

r.  •*. 

.  %  4%  A  • 

*  •  *  •  ,t  ' 

Course  2 

.26  (.26) 

.03  (.02) 

.21  (.08) 

.50  (.19) 

M*'*  *'• 

TABLE  4 

Proportion  of 

moves  In  each 
SO  in  0 

performance  category. 

• 

4.'"*  * 
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ABSTRACT 

•^An  experiment  is  described  in  which  operators  performed  a  tracking 
task  whose  difficulty  was  varied  on  two  dimensions,  bandwidth  and  order  of 
control.  RMS  error  was  measured  and  subjective  judgement  of  workload 
obtained  on  a  10-point  scale.  Using  rms  error  as  a  measure  of  subjective 
effort,  the  workload  was  successfully  predicted  using  fxizzy  measures^  of 
bemdwidth,  order  of  control  and  effort.  ^ 

INTRODUCTION 

One  aspect  of  mental  workload  vAiich  has  been  of  interest  is  the 
relation  between  objective  "task  difficulty,"  performance  measures,  and 
subjective  judgements  (Moray,  1979) .  The  original  intention  of  the  experi¬ 
ment  described  was  to  use  physiological  measures  as  well ,  and  explore  the 
correlations  between  the  different  measures  of  workload.  The  chosen 
physiological  measure  (power  at  0.1  Hz  in  the  heart  rate  spectrum)  did  not 
correlate  with  any  of  the  other  measures  and  will  not  be  further  discussed. 
Instead,  after  describing  the  experiment,  we  will  report  on  the  need  to 
take  into  account  the  amount  of  effc_t  put  into  a  task,  since  uhat  approach 
enabled  some  anomalous  data  to  be  successfully  explained.  Intuitively  it 
seems  clear  that  if  a  person  is  confronted  with  an  objectively  difficult 
task  but  does  not  try  hard,  then  it  may  be  experienced  as  subjectively  less 
loading  than  one  might  expect. 


METHOD 


A  single  axis  compensatory  tracking  task  was  used,  in  which  the 
operator  was  required  to  keep  a  vertical  bar  between  two  reference  bars 
which  represented  the  permissible  error.  These  bars  were  +  0.5a  from  the 
mean  of  the  forcing  function,  which  was  Gaussian  bandlimited  noise,  (w^O, 
a*l)  .  'Biree  bandwidths  were  used,  0.33,  0.67  auid  1.0  Hz,  provided  by  a 
Hewlett  Packard  Pseudorandom  noise  generator  set  at  50  Hz  and  lowpass  "iltered 
with  a  Kemo  programmable  filter.  Three  orders  of  control  were  used,  K,  K/s 
and  K/s^.  The  three  bandwidths  and  three  orders  of  control  were  combined 
into  9  conditions,  and  9  operators  performed  them  in  a  Latin  Square  design. 
They  received  two  days'  practice  before  the  data  were  collected,  and  the 
analysis  was  based  on  two  days  worth  of  data,  on  each  day  of  which  they 


perfozioed  all  nine  conditions.  There  were  no  significemt  differences 
between  the  two  days  of  data,  and  both  will,  be  analysed.  The  experiment 
was  run  through  an  EAI  analogue  computer  controlled  by  a  PDPll/45  which 
provided  the  control  of  the  filter  and  collected  and  scored  the  data.  After 
each  condition  the  operator  was  asked  to  rate  the  subjective  load  ingposed 
by  the  experimental  condition  on  a  ten  point  scale. 


RESULTS 

The  results  are  shown  in  sununaxy  in  Figures  1  and  2.  ANOVAS  showed 
that  the  main  effects  of  treatments  were  the  only  significant  source  of 
variance.  As  was  expected,  increasing  the  bemdwidth  and  increasing  the 
order  of  control  each  made  the  task  subjectively  more  difficult,  increasing 
the  order  of  control  also  increased  the  rms  error,  as  expected.  But  there 
was  an  anomalous  effect  in  that  increasing  the  bandwidth  decreased  the  rms 
error.  The  equipment  and  the  data  were  carefully  scrutinized  to  see  whether 
this  was  an  artefact,  but  in  the  end  it  appeared  to  be  a  real  finding. 
Talking  to  operators  and  performing  the  task  led  to  the  conclusion  that 
0.23  Hz  was  so  low  that  the  operators  probably  did  not  try  very  hard,  and 
that  perhaps  their  response  to  the  increasingly  difficult  bandwidths  was  to 
more  than  compensate  for  the  -difficulty,  so  that  performance  overcompensated 
for  the  task  demands.  It  was  chis  that  suggested  trying  to  estimate  sub¬ 
jective  effort  and  take  it  into  account.  In  the  absence  of  objective 
measures  of  effort  it  was  decided  to  take  the  opportunity  to  see  whether 
fuzzy  set  theory  could  be  used  to  measxure  workload. 


We  define  a  fuzzy  set  of  situations  which  are  subjectively  heavily 
loading  by  a  linear  transform  on  the  subjective  judgement  scale, 

Up  =  0.1  (R)  0  1^1  i0*0 

where  R  is  the  score  given  by  the  operators  on  the  ten-point  scale.  That 
is,  the  higher  the  subjective  rating,  the  stronger  the  cemdidacy  for 
membership  of  a  "heavily  loading  situation." 


The  Imposed  load  is  due  to  the  two  task  parauneters ,  bandwidth  and 
order  of  control.  We  propose  that  "high  bemdwldths"  and  "high  orders  of 
control"  both  isposo  heavy  loads.  The  membership  function  of  "hl^  orders 
of  control"  cem  be  plausibly  related  to  known  empirical  facts  about  manual 
control.  Controlled  elements  with  transfer  functions  K  and  K/s  are  easy 
to  control,  K/s^  is  very  hard,  and  hi^er  orders  impossible.  These  consi¬ 
derations  suggest  a  membership  function  as  shown  in  Figure  3.  The  exact 
values  are  at  present  a  matter  for  arbitrary  choice.  Without  trying  to 

optimize  the  fit  to  the  data,  we  set  p  (K/s)  >  0.2,  and  u.(K/s^)  »  0.6. 

s 


W„(K/s2) 

O 


The  membership  function  of  "high  bandwidths"  we  also  relate  to 
empirical  data.  The  human  operator  transfer  function  is  well  known,  and  we 
propose  that  a  possible  reason  for  high  bandwidths  being  difficult  is  the 
increasing  phase  lag  associated  with  bandwidth.  We  therefore  plot  the  Bode 
phaaa  curve  inverted  and  treat  this  as  the  membership  function  for  "band- 
widtha  which  are  high."  A  phase  lag  of  -180°  is  certainly  high  in  this 
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sense,  euid  frequencies  below  the  breakpoint  have  zero  membership  of  high 
bandwidths.  (Figure  4.) 

Since  bandwidth  and  order  of  control  are  independent  sources  of 
difficulty,  their  combined  effect  is  the  fuzzy  union  of  their  memberships, 
and  we  have 

u_  *  max  j  w  (u) } 

T  B  (ji 

where  is  the  membership  of  "tasks  which  are  difficult." 

The  problem  of  estimating  effort  is  not  so  direct.  Wo  try  to  deduce 
it  here  from  the  rms  error.  To  reduce  error  requires  effort.  But  the 
operators  in  this  experiment  were  allowed  an  explicit  acceptable  error 
band.  Clearly  any  error  within  that  band  is  not  a  member  of  "errors  which 
are  large."  On  the  other  hand,  since  the  forcing  function  was  Gaussian, 
we  might  reasonably  say  that  any  error  which  is  greater  than  _+  2a  is 
certainly  large.  We  assume  that  making  a  large  error  meams  that  the 
operator  is  not  putting  a  lot  of  effort  into  the  task.  Hence  we  have  the 
membership  function  for  "errors  which  are  large"  shown  in  Figure  5. 

We  now  define  the  membership  of  "putting  a  lot  of  effort  into  the 
task"  as  the  complement  of  the  membership  function  of  "errors  which  are 
large , "  and  we  have 

“e  ■  -  >'e> 

We  now  make  the  assumption  that  in  order  for  a  task  to  seem  subjec¬ 
tively  loading  it  must  both  be  objectively  difficult  and  also  be  given  a 
lot  of  effort.  The  appropriate  relation  is  the  fuzzy  intersection  of  task 
difficulty  and  effort,  and  we  have  finally, 

y_  =  min  {  max(y  ;  u  ) ;  (l-u„) } 

0  s  u>  E 

which  allows  us  to  calculate  the  predicted  subjective  task  difficulty.  In 
Figure  6  we  show  the  relation  between  the  task  difficulty  predicted  from 
this  fuzzy  set  model,  together  with  the  observed  subjective  ratings  rescaled 
to  the  range  0  to  1.  The  squares  are  from  the  first  and  the  circles  from 
the  second  days'  data.  Eight  out  of  the  nine  individual  operators  showed 
good  linear  relationships.  It  should  be  emphasized  that  no  attempt  has  been 
made  to  optimize  the  membership  functions  by  direct  scaling.  Rather  it  was 
thought  preferable  to  try  to  establish  the  membership  functions  independent¬ 
ly  of  subjective  judgement,  so  as  to  have  a  more  cmalytic  model.  We  believe 
that  the  results  suggest  that  fuzzy  measurement  has  a  promising  application 
in  the  field  of  mental  workload  measurement.  Further  experiments  are 
currently  underway  at  Toronto,  Including  measures  of  the  effect  of  combining 
the  subjective  difficulty  of  two  tasks.  Interesting  preliminary  results  are 
available.  For  example,  combining  two  tasks  of  moderate  difficulty  produces 
a  difficult  or  very  difficult  task:  comining  two  difficult  tasks  produces 
a  very  difficult  task,  and  the  impression  is  that  neither  averaging  nor 
addition  takes  place  for  subjective  difficulty,  but  rather  something  corres¬ 
ponding  to  a  shift  operator  which  moves  the  membership  function  towards  the 
higher  end  due  to  combination. 
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ABSTRACT 

t 

y 

‘^^^Twalva  ganaral  aviation  pileta  partioipatad  in  a  two- 
day.  axpariaant  parforalnq  foartaaka  intandad  to  Load  - 
on  diffarant  cognitiva,  pareaptual#  and  aotor  diaan- 
aiona*  Tha  taaka  wara  variad  in  apparant  difficulty 

Laval  ao  that  aach  pilot  parforaad  a  total  of  aixtaan 
taaka  countar-balancad  for  taak  and  laval.  Subjaotiva 
ratinga  of  factors  contributing  to  workload  wara  aada 
iaaadiataly  following  aach  laval  of  aaoh  taak  uaing  a 
IS  bipolar  adjactiva  acala«  *  Raaults  indicatad  that 
tha  aubjactiva  parcaption  of  workload  was  not  ralatad 
to  actual  parforaanca  aaasuraai  howavar,  tha  aubjac¬ 
tiva  ratings  wara  ganarally  consistant  with  tha 
daaands  aada  by  tha  lavals  of  aach  task.  Although 
only  two  of  tha  rating  seals  itaas,  own  Parforaanca 
and  Task  Difficulty,  daaonotratad  significant  within- 
task  diffarancas  for  all  four  tasks,  tha  aajority  of 
rating  sealas  showad  witbin-task  diffarancas  for  thosa 
tasks  that  iaposad  bighar  cognitive  daaands.  Strong 
ralationships  wara  found  batwaan  Ovarall  Morkload, 
Strass  Laval,  and  Task  Difficulty  ratinga  on  all 
tasks, 

INTRODUCTION 

Xn  tha  past  year  thsra  has  baan  a  graat  daal  of  intarast  in  tha 
subjact  of  defining,  acasuring  and  reducing  pilot  workload  as  a 
rasult  of  the  President's  task  force  on  craw  eoaplaaent.  In 
their  attempt  to  determine  how  beat  to  certify  an  aircraft  with 
respect  to  ainimum  craw  sisa,  it  bacama  clear  that  a  critical 
factor  was  workload. 

Although  thara  is  soma  broad  ganaral  agraaaant  on  defini¬ 
tions  of  workload,  thara  is  little  agraamsnt  on  what  the  specif¬ 
ic  factors  are  that  contribute  to  workload  either  singly  or  in 
combination,  nor  are  thara  any  standard  ssts  of  procaduras  or 
techniques  that  can  be  used  to  maasura  workload*  Recent 
research  (Hart,  Childrass  a  Hauser,  1982)  suggests  that  a  number 
of  independent  dimensions  of  workload  can  be  identified  and, 
further,  that  differing  combinations  of  these  factors  are 
relevant  to  different  individuals  in  axperiancing  workload. 


Th«  foeua  of  th«  prasant  study  was  to  dataraina  what  aa* 
pacta  of  diffarant  task  altuationo  causa  an  individual's  axpari* 
anca  of  workload  and  rolatad  factors  to  vary.  Subjactivs  rating 
soalas  provide  one  aethod  of  evaluating  workload  (Bird.  1961 t 
Hicks  6  Hiarwille,  1979)  Jex  «  Claaent.  1979)  Villiges  a 
Niarwille.  1979),  particularly  whan  ooabinad  and  eoapared  with 
objective  perforaance  aeasures.  The  present  study  built  on  pre¬ 
vious  research  (Bird,  1981)  which  exaainad  the  affect  of  dif¬ 
ferent  factors  on  the  the  individual's  experisnce  of  workload 
using  a  single-axis  ooapens^toi^  tracking  task  with  six  levels 
of  diffioulty.  ~  Bubjacts  rated  each  laval  of  the  tracking  task 
using  a  IS  bipolar-adjective  scale  that  addressed  a  variety  of 
factors  assuaed  to  be  related  to  the  subjective  experience  of 
workload.  Factors  related  to  the  difficulty  levels  of  the  task 
were)  skill  required,  task  difficulty,  controllability,  and 
task  deaands.  The  increase  in  subject  effort  (stick  input)  was 
shown  to  be  related  to  evaluations  of  skill  required,  task  coa- 
plexity,  task  difficulty,  and  task  deaands. 

In  the  present  experiaent  four  different  tasks  (including 
several  levels  of  the  tracking  task  used  by  Bird),  each  with 
four  levels  of  difficulty,  were  presented  to  the  subjects,  who 
were  required  to  rate  each  level  of  each  task  iaaedlately  after 
its  perforaance  using  a  aodified  version  of  the  earlier  scale. 
Although  the  tasks  chosen  for  use  in  this  experiaent  (coapensa- 
tory  tracking,  the  fternberg  task,  auditory  aonitoring,  and  tlae 
estiaation)  are  coaaonly  eaployed  ss  secondary  aeasures  of  work¬ 
load,  in  this  instance  they  were  used  only  as  priaary  tasks  in 
order  to  obtain  ratings  that  would  stand  aloes  and  thus  be  use¬ 
ful  for  future  research  ooaparisons  where  these  tasks  will  func¬ 
tion  as  secondary  tasks. 


METHOD 


Subjects 

Twelve  general  aviation  pilots,  ten  nales  and  two  feaales, 
21  to  43  years  old,  served  as  paid  volunteers.  All  subjects 
were  right  handed. 


Apparatus 

All  experiaental  sessions  were  conducted  in  a  snail, 
sound-attenuated  experiaental  cbanber.  The  subject  was  seated 
in  a  oonfortabls  chair  approxinately  100  cn  away  fron  the 
Cathode  Ray  Tube  (CRT)  screen.  The  control  stick  used  for  the 
tracking  task  was  located  on  the  right  arn  of  the  chair.  The 
button  press  used  for  the  tine  estiaation  task  was  centrally 
nounted  on  the  top  of  the  control  stick.  Brass  buttons  usad  for 
both  ths  Sternberg  nenory  task  and  ';.he  auditory  aonitoring  task 
were  nounted  on  tbs  left  era  of  the  chair,  with  all  functions 
clearly  labeled.  The  analog  control  for  rating  evaluations  was 
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•lae  Bountad  on  the  left  era  of  the  chair*  Data  ware  recorded 
and  taek  preaentationa  were  prograaaed  on  a  Digital  Kquipaent 
Corporation  PDP**12  coaputer. 

Subjective  Rating  Scale.  The  eulti-diaenaional  rating  acale 
conaiated  of  15  deacriptive  iteaa  that  addreaaed  apecific  fac* 
tora  that  aay  contribute  to  an  individual 'a  perception  of  work- 
loadi  cognitive,  perceptual,  and  payehoaotor  diaenaiona  aa  well 
aa  feelinga  of  atreaa,  fatigue,  aotivation,  tiae  preaaure,  etc. 
The  specific  scalea  sere  dichotoBiead  to  two  aKtreaa  oppoaite 
ievelaV  lOverali  Workload  (Bigh/Low),  Perforaanoe  (Great/Lousy'., 
Training  (Too  Much/Too  Little),  Attention  Level  (Constant/Mone ) , 
Motivation  (Bxcited/Indif f erent ) ,  Straaa  Level  (Bxtreaely 
Tense/Relaxed),  Phyaical  State  (Wide  Awaka/Bxhauated) ,  Tiae 
Pressure  (Very  Rushed/None),  Task  Difficulty  (Very  Bard/Very 
Easy),  Task  Ceaplexity  (Very  Coaplex/Very  Slaple),  Activity  Lev¬ 
el  (Vary  Buay/Xdla),  Phyaical  Effort  (High/Low),  Mental  Effort 
(Bigh/Low),  Sensory  Effort  (High/Low). 

The  scales  ware  displayed  singly  in  the  above  sequence  on  a 
CRT  screen.  The  specific  scale  descriptor  was  poaitioned  at  the 
bottoa  of  the  screen,  with  the  scale  itaelf  represented  by  a 
vertical  line  (11.0  ca)  aarked  with  "ticks"  at  both  ends  and  in 
the  Biddle.  The  dichotoaous  definitions  were  placed  adjacent  to 
the  identifying  ticks  at  the  top  and  bottoa  of  the  scale.  Sub¬ 
jects  assigned  a  subjective  rating  by  positioning  a  cursor  along 
the  vertical  line.  They  were  required  to  *sero*  the  cursor  by 
positioning  it  at  the  base  of  the  vertical  line  before  asking 
each  rating.  Subjects  ratings  were  eoaputed  as  a  percentage  of 
the  distance  froa  the  bottoa  stationary  tick  aark  (0)  to  the  top 
stationary  tick  aark  (100). 

Tracking  Task .  Pour  levels  of  difficulty  for  a  single-axis 
coBpensatory  tracking  task  were  presented  on  a  aonitor.  The 
display  consisted  of  a  vertical  line  (3.7  ca)  which  aoved 
quasi-randoBly  in  a  lateral  direction.  The  subjects'  task  was 
to  keep  this  cursor  centered  between  two  atatiunary  vertical 
lines  (1.5  ca)  by  aoveaent  of  a  control  stick. 

The  output  of  a  randoa  nuabar  generator  provided  a  rec¬ 
tangular  distribution  of  frequencies  siaulating  white  noise  with 
a  bandpass  of  62  rad/sec.  The  values  ware  passed  through  a 
second-order  filter  having  a  natural  frequency  of  1.0  or  2.0 
rad/see.  The  resulting  forcing  functions  were  presented  with 
standard  deviations  of  either  33  pixils  (12%  of  the  screen 
width)  or  64  pixils  (24%  of  the  screen  width)  to  reproduce  four 
of  the  six  experiaental  conditions  used  by  Bird  (1981).  The 
resulting  task  difficulty  levels  thus  were  varied  with  respect 
to  frequency  and  aaplitude  so  as  to  deteraine  the  independent 
and  coabined  effects  of  these  two  factors  on  the  experience  of 
workload. 
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SfrnbTq  Wmory  T««K .  Th«  ••cond  set  of  four  tasks  was 
dssignsd  to  lovastlgats  ths  offset  of  asaory  load  and  prsssnta- 
tion  rats  on  ths  sxpsrlsncs  of  workload.  Ths  wldsly  ussd  Stsrn* 
bsrg  task  (Stsrnbsrg,  1966)  was  prograaasd  so  as  to  ersats  four 
Isvsls  of  difficulty.  This  task  involves  asaorisation  of  ons  or 
aore  alphabet  characters.  tbs  "positive  set”,  with  subsequent 
presentation  of  a  series  of  characters  requiring  true  or  false 
responses  to  those  which  were  or  were  not  aeabers  of  the  posi¬ 
tive  set. 

Two  levels  of  difficulty  were  aanlpulated  by  the  use  of  ei¬ 
ther  a  single  letter  or  five  letters  as  aeabers  of  the  positive 
set.  There  were  two  levels  of  rate  of  presentation  with  the 
inter-stiaulus  interval  set  at  either  1.5  or  3.0  seconds. 
Letters  were  displayed  for  1.0  seconds  in  all  experlaental  con¬ 
ditions.  A  randoaly  generated  set  of  alphabetic  characters  was 
produced  for  each  of  the  four  levels  of  this  task.  with  the 
stipulation  that  the  positive  set  character (s)  appeared  SO  per 
cent  of  the  tiae.  The  letters  (0.75  ca  high.  0.50  ca  wide)  were 
presented  on  a  CRT  screen.  Subjects  responded  by  button  press 
(yes  or  no)  to  the  stiauli  depending  on  whether  or  not  the 
displayed  character  was  a  acaber  of  the  positive  set. 

Auditory  Monitoring  Task .  An  auditory  aonitoring  task  was 
included  in  the  test  battery  to  further  investigate  the  iapact 
of  aeaory  load  and  presentation  rate  with  a  non-verbal  taak. 
The  coaplex  counting  taak  devaloped  by  Kennedy  (1968>  1971)  was 
selected  because  it  has  baan  shown  that  this  task  is  associated 
with  very  stable  within-  and  between-sub jact  perforaance  for 
differant  levels  of  difficulty. 

The  present  version  of  the  task  was  presented  with  two  lev¬ 
els  of  aeaory  load,  siailar  to  those  used  by  Kennedy.  Two  lev¬ 
els  of  rate  of  presentation  were  also  eaployed.  departing  froa 
Kennedy's  use  of  one  presentation  rate,  to  investigate  the  ef¬ 
fect  of  tiae  pressure  variation  at  low  lavals  of  task  deaand. 
The  aeaory  load  required  either  a  response  to  all  occurraneas  of 
one  designated  tone  (ou  load)  or  to  every  2nd  or  4th  occurrence 
of  such  a  tone  (aaacry  load).  Three  tones  (lcw/448  Bs.  aedi- 
ua/11S2  Hx.  high/1988  Uz)  were  sequenced  so  that  the  high  tone 
occurred  8  tiaes  per  ainute.  the  aiddle  tone  12  tiaes  per 
ainute.  and  the  low  tone  16  tiaes  per  ainute  for  the  fast  ver¬ 
sion  and  4.  6.  and  8  tiaes  per  ainute  for  the  slow  version.  All 
tones  in  all  conditions  were  activated  for  0.4  seconds.  The 
tones  were  produced  by  a  Navetek  Voltaga  Control  Genarator  with 
voltaga  fed  by  the  PDF-12  0-to-A  converter,  the  output  gated  on 
and  off  by  a  logic  signal  froa  ths  FDF-12  coaputsr  and  praaented 
to  the  subjects  through  a  four-inch  intercoa  speaker.  Subject 
responses  were  aade  by  labeled  button  press  (hi.  aed.  lo). 

Tiae  Istiaation  Task.  Tiae  estiaation  tasks  were  included 
in  the  test  battery  because  they  represent  tasks  that  are 
stiaulus-def icient .  invoking  a  siaple  infrequent  response  but 
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ntccssitating  continuad  attantlon  by  tha  aubjact  to  produea  eon* 
aiatant  and  aoourata  raaponaaa  (Bart«  NePharaon*  a  *x<ooaia« 
1978)  . 


Two  lawals  of  aattaod  of  tlaa  aatlaation  wara  uaadt  produc¬ 
tion  or  varbal  aatiaatlon.  Two  aatiaation  tachniquaa  wara 
variad  uadar  aacb  aatbodt  aithar  counting  aloud,  or  with  no  at* 
taapt  at  any  typa  of  rhythaic  monitoring  of  the  pasaaga  of  tiaa. 
Although  aatiaation  and  production  accuracy  hava  baan  ahown  to 
ba  aiailar  with  both  tachniquaa,  aubjactiva  raporta  indicata 
that  tha  two  tachniquaa  diffar  aarkadly  with  raapact  to  atraaa, 
attantion- raquirad,  uncertainty,  and  pareaivad  accuracy.  Again, 
thaaa  four  lawala  of  taak  daaand  wara  aalactad  to  dataraina  tha 
affact  of  ralatiwaly  aubtla,  but  nona*tha*laaa  important,  pri* 
aarily  oognitiva  paraaatara  on  tha  axparianca  of  workload. 

Tha  intarvala  usad  ranged  in  duration  from  5*14  aaconds  and 
wara  praaantad  in  a  random  order  vith  each  interval  appearing 
twice  in  every  aeaaion.  Tha  beginning  of  each  trial  was  sig* 
naiad  by  a  aassaga  on  a  CRT  screen,  a.g.,  “Production 
seconds*,  or  "Begin  Interval*  for  tha  production  or  verbal  aati* 
nation  rasponsas  raspactively .  Tha  subject  responded  with  a 

button  press  which  initiated  either  tha  production  of  the  spaci* 
fiad  interval  or  tha  presentation  of  tha  interval  to  ba  astiaat- 
ad.  A  second  button  press  signaled  completion  of  a  produced  in* 
tarval  or  indicated  that  tha  subject  had  noticed  that  the  inter* 
val  had  ended  and  thus  could  make  tha  astiaata.  This  procedure 
was  designed  to  hold  constant  both  tha  number  and  typa  of  overt 
responses  and  visual  information* 

Procedure 


Subjects  were  given  a  briefing  at  tha  start  of  the  first 
day  of  experiaantal  sessions.  Descriptions  of  the  tasks  ware 
given,  as  were  instructions  for  tha  parforaance  of  the  teaks  and 
tha  subsequent  ratings*  Tha  importance  of  maintaining  an  equal¬ 
ly  high  standard  of  parforaance  across  all  tasks  was  stressed* 
All  subjects  wara  given  a  copy  of  tha  definitions  provided  for 
each  of  the  rating  scale  items  and  were  encouraged  to  refer  to 
it  and  to  exercise  careful  consideration  during  the  rating  pro¬ 
cedure  * 

Tha  order  of  presentation  of  tasks  and  levels  of  tasks  was 
counterbalanced  across  tha  13  subjects*  Tha  entire  experiment 
was  run  over  a  one  and  a  half  day  period*  Subjects  performed 
throe  or  four  of  tha  laboratory  tasks  par  45*oinuta  session,  in¬ 
terspersed  with  sessions  that  involved  flying  a  motion-based 
general  aviation  trainer  <GAT)  simulator*  Tha  GAT  simulator 
study  will  be  reported  elsewhere*  Breaks  wara  given  between 
sessions* 

For  all  tasks,  subjects  practiced  for  one  minute  immediate¬ 
ly  prior  to  a  four-minute  oxparimantal  session.  The  tiaa  esti* 
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■ation  task  langth  variad  aa  a  raault  of  aabjaot  raapoasaa,  but 
typically  laatad  4-5  ainutaa.  Aftar  ooaplatlon  of  aach  aapati- 
■antal  task,  sobjacts  ratad  thair  aubjaetlva  aaparianca  on  aach 
of  tha  IS  bipolar  Itaaa. 

At  tha  and  of  tha  axpariaant,  aubjacta  ratad  thair  aggra- 
gata  aaparianca  aoroaa  all  of  tha  taska  on  tha  aaaa  15  bipolar 
rating  acalaa  ao  that  a  ooapariaon  oould  ba  aada  batwaan  tha  ag- 
gragata  rating  and  tha  aaan  ratinga  across  all  lavals  and  tasks. 

RI80LT8  AND  D18CU88X0N 


Tha  primary  focus  of  tha  data  analyaia  was  on  tha  ratinga 
olxainad  within  and  batwaan  tasks.  In  addition,  appropriate 
oaasuraa  of  affort  and  parforaanca  wars  analyaad  for  aach  task 
and  comparad  to  tha  aubjaetlva  ratings.  All  data  analysas  on 
tha  parforaanca  aaaauraa  of  tha  four  axpariaantal  tasks  and  tha 
ralatad  rating  aealas  wars  coapu^ad  using  ona-  and  two-way  Ana¬ 
lysas  of  Varlanca  (ANOVAS)  with  rapaatad  aaaauras. 

Bstwaan-Taak  Ratinga 

Piftaan  ona-way  AN0VA8  wara  parforaad  using  tha  moans  of 
tha  aubjacta*  ratinga  across  tha  four  lavals  within  aach  task  in 
ordar  to  dataraina  if  tha  aealas  dlacriainatad  batwaan  tha  four 
typas  of  tasks.  Thara  wara  significant  diffaranoas  for  all 
aealas  axeapt  Training  and  Physical  itata  (ssa  Pigura  1),  indi¬ 
cating  that  tha  ratings  did  raflaet  tha  diffarant  daaands  la- 
posad  by  diffarant  task  typa.  A  Mawaan-Ksuls  tsst  for  ordsrad 
asans  showsd  that  tha  significant  offsets  for  tha  ratinga  of 
Ovarall  Workload,  Attantion  Laval,  Strass  Laval,  and  Activity 
Laval  wara  dua  to  highar  ratings  ou  tha  tracking  and  Stsrnbarg 
tasks  than  for  tha  auditory  monitoring  and  tlaa  astlaatlon 
tasks. 


Tha  significantly  battar  avaluations  of  own  Parforaanca  on 
tha  Jtarnbsrg  and  auditory  aonitoring  tasks  probably  raflactad 
tha  aora  quantitativa  natura  of  thasa  two  tasks.  Subjacts  wars 
in  offset  abla  to  monitor  thair  own  suecass  or  failure  on  a  sia- 
pla  right  or  wrong  basis,  wharaas  no  such  evaluation  oould  ba 
aada  for  tha  tracking  or  time  astiastion  tasks  as  tbs  paresption 
of  sucesss  was  such  aora  nabulous  for  thasa  tasks.  It  should  ba 
raaaabarad  that  no  faadbaek  was  glvsn  to  subjacts  about  thair 
parforaanca . 

Tina  astlaatlon  was  parcaivad  as  tha  laast  intarasting  task 
tha  four,  but  thara  wars  no  diffarsneas  on  tha  ratad  Motiva¬ 
tion  batwaan  tha  tracking,  Starnbsrg,  and  auditory  aonitoring 
tasks.  As  tha  saaa  rasult  was  found  on  tha  Sensory  fffort 
scale,  it  appears  intuitively  raasonabla  that  tha  low  pareaptnal 
daaands  of  tlaa  sstiaation  resulted  in  a  lack  of  interest. 

Tha  tracking  tasks  wara  significantly  aora  difficult  than 
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Rating  scale  aeans  and  standard  errors  calculated  over  the  four  level: 
.kwith  significant  betMeen  task  differences  identified  **  IK.OI,  ***  i 


•ny  of  tb«  othor  thro*  took*  <«hieh  wor*  rotod  os  oquivolontly 
difficult),  whoroos  rbysiool  Effort  rotings,  oLthoufh  low,  wor* 
oignif ieontly  grootor  for  tho  troeking  ond  Stornbcrg  tasks,  ro* 
flooting  th*  high  rospeas*  domonds,  than  for  oithor  tho  tia*  **• 
tiaation  or  auditory  aoaitoring  tasks* 

Difforoaoos  botwooa  tasks  on  th*  Bnorgy  bovol.  Task  Coa- 
ploxity,  and  Montal  Effort  scalos  wora  saall  in  gonoral,  and  the 
Training  and  Ehysical  Etato  aeal*  ratings  woro  nearly  identical 
across  tasks.  All  subjects  rated  training  as  at  least  adequate 
(at  th*  50  per  cent  level)  or  elightly  aore  than  adequate.  The 
subjects'  Physical  State  or  level  of  fatigue,  was  apparently  net 
differentially  affected  by  task  type*  Overall  Workload  was  rat¬ 
ed  at  about  th*  aid-range  for  the  tracking  and  Sternberg  tasks, 
and  IS  to  20  per  cent  lower  than  that  for  th*  auditory  aonitor- 
ing  and  tia*  estiaation  tasks.  The  effort  ratings  wor*  rarely 
above  the  aid-range  with  the  exception  of  th*  Sensory  Effort 
ratings  on  the  tracking  and  Sternberg  tasks,  indicating  that  in 
general  subjects  felt  that  th*  doaanda  of  th*  tasks  were  not 
very  high. 

Within-Task  Analyae* 

Tracking  Task t  Objective  Measures .  Two  soasures  of  porfor- 
aanc*  were  oxaainedt  (1)  EMS  (root  aoan  squares)  tracking  error 
over  EMS  input  (i.e*,  how  auch  the  error  was  reduced  by  the  sub¬ 
jects*  action)  and  (2)  EMS  of  the  stick  saaplos  (i.e*,  how  such 
stick  aoveaent  was  aads  by  the  subjaet).  An  increase  in  the 
bandwidth  caused  an  increase  in  tracking  error  EMS,  which  aight 
be  expected  considering  th*  relative  aaount  of  error  th*  subject 
was  required  to  reduce.  Increasing  th*  standard  deviation  (froa 
32  to  64)  produced  an  ineroas*  in  th*  stick  output  which  is  also 
intuitively  reasonable  as  th*  travel  distance  of  th*  cursor  was 
doubled . 

Th*  aore  difficult  levels  of  standard  deviation 
(r( 1 ,  1 1  )s19. 12,  £<.001)  and  bandwidth  (P(  1 ,  11 )*273. 53,  £<*0001  ) 
conditions  resulted  in  significant  deoreaents  of  the  degree  to 
which  subjects  succeeded  in  reducing  signal  errors,  however,  the 
standard  deviation  accounted  for  only  2%  of  the  variance  whereas 
th*  bandwidth  accounted  for  79%  of  th*  variance.  For  th* 
bandwidth  of  1.0  rad/sec,  the  error  was  reduesd  by  about  50%, 
b.ut  th*  bandwidth  of  2*0  rad/sec  showed  an  error  reduction  of 
only  15%.  Th*  error  reduction  was  grsater  for  the  standard  de¬ 
viation  of  32  than  for  64  only  when  th*  bandwidth  was  1.0 
rad/sec . 

Stick  activity  was  also  significantly  greater  for  th*  aore 
difficult  levels  of  both  variablesi  standard  deviation 
P( 1,  11)>117.01,  £<.0001,  and  bandwidth  F (  1 ,  1 1 )-3 3 . 60 ,  £<.0001. 
In  this  ease  the  standard  deviation  accounted  for  40%  of  the 
variance  and  bandwidth  for  16%  of  th*  variance.  Doubling  th* 
standard  deviation  did  in  fact  double  the  stick  activity, 
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wh«r«aa  iaeraaalng  tha  bandwidth  troa  1.0  to  2.0  rad/aae  in- 
craaaad  atlok  aetlvlty  by  about  S0%. 

Tracking  Taak^  Rating  Soalaa.  Xt  was  antioipatad  that  tha 
inoraaaing  difficulty  lawals  of  tha  task  would  ba  raflaotad  in 
subjacts*  rating  of  tha  workload  inwolwad.  In  fact*  only  five 
of  tha  rating  seals  itaaa  did  produca  significant  diffaraneas  in 
tha  axpaotad  diraotion.  as  shown  in  Plgura  2.  Tha  parcantagas 
of  warianoa  aeeountad  for  wars  ganarally  snail,  so  although 
diffaraneas  wars  pareaiwad  thay  wars  apparantly  in  a  linitad 
ranga.  Tha  incraasa  in  bandwidth  affaetad  Parfornanoa  and  Ac¬ 
tivity  Laval  rstingsi  subjaets  avaluatad  thair  parforaanca  as 
lass  succassful  whan  tha  bandwidth  was  2.0  rad/sac.  and  highar 
Activity  Laval  ratings  raflactad  incraasad  stick  activity  assc- 
ciatad  with  an  incraasa  in  tha  bandwidth  from  1.0  to  2.0 
rad/sae.  Tha  incraasad  standard  deviation  produced  lower  rat¬ 
ings  on  tha  Motivation  scale  and  highar  ratings  on  tha  Task  Dif¬ 
ficulty  scale.  The  interaction  of  bandwidth  and  standard  devia¬ 
tion  affected  tha  Stress  Laval  scale  with  the  largest  difference 
again  attributable  to  the  standard  deviation  variable. 

Zn  general,  tha  Attention  Laval  required  for  the  tracking 
task  was  thought  to  ba  very  high,  and  the  Sensory  Sffort  and  Ac¬ 
tivity  Level  ware  both  perceived  as  being  aodarately  high.  Task 
Coaplaxity.  Physical  Effort,  and  Tiaa  Pressure  were  all  rated  as 
relatively  low. 

Sternberg  Taskt  Objective  Measures .  Two  aaasuras  of  par- 
forasnea  ware  axaainadi  (1)  reaction  tiae  for  correct 
responses,  and  (2)  par  cent  of  correct  responses.  There  was  a 
significant  increase  in  reaction  tine  (  P(  1  >  1 1  )<■  185 . 68 .  £<.0001  ) 
as  the  aeaory  set  sise  was  increased  fron  1  to  5  characters  as 
expected.  and  reaction  tiaes  were  slower,  but  not  significantly 
so.  for  the  slower  rate  of  presentation.  There  was  no  signifi¬ 
cant  variation  in  the  par  cant  of  correct  responses  for  either 
rata  of  presentation  or  nanory  sat  sisa.  although  there  was  a 
decrease  in  per  cent  correct  for  tha  faster  rata  of  presentation 
whan  the  nanory  set  sise  was  1. 

Sternberg  Task t  Rating  Scales.  Tha  rate  of  presentation 
did  produce  a  significant  affect  on  11  of  tha  15  bipolar  rating 
scales  as  shown  in  Figure  3.  In  every  case  the  faster  rata  pro¬ 
duced  highar  ratings,  except  for  tha  Parforaanca  scale,  where 
parforaanca  was  rated  as  poorer  for  tha  faster  rate.  Tha  tan 
scales  that  showed  higher  ratings  for  the  faster  rata  of  presen¬ 
tation  warai  Overall  Workload.  Stress  Level,  Energy  Level.  Tine 
Pressure.  Task  Difficulty.  Task  Coaplaxity,  Activity  Level.  Phy¬ 
sical  Effort.  Mental  Effort,  end  Sansory  Effort.  Ratings  on 
these  scales  did  securately  reflect  the  greater  deaands  cade  by 
the  faster  rate  as  subjects  did  have  to  respond  twice  as  often 
for  the  faster  rate  of  presentation  with  40  button  presses  per 
ainute  coapared  to  20  for  the  slower  rate.  Rather  than  perceiv¬ 
ing  tha  increased  rate  as  fatiguing,  subjects  apparently  felt 
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th«t  th«ir  vnargy  laval  waa  anhanead. 

Tha  nuBbar  of  eharaetara  in  tha  poaitlva  aamory  aat  rasulc- 
ad  in  aignificant  diffarancaa  on  aavan  of  tha  IS  bipolar  acalaai 
Ovarall  Workload,  Parforaanca,  Knargy  Laval,  Tiaa  Praaaura,  Task 
Difficulty,  Task  Coaplaxity,  and  Activity  Laval,  and  again  tha 
graatar  daaand  waa  raflaetad  in  highar  ratings  axcapt  for  Par> 
foraanca,  wbara  tha  rating  waa  lowar  for  tha  aaaory  sat  of  5. 
As  was  ahown  in  tha  objactiva  aaaaura  analysis,  succassful  par* 
foraanca  was  significantly  lowar  for  tha  aaaory  sat  of  5  as  coa* 
parad  to  that  of  1.  As  was  tha  casa  for  incraasad  rata  of 
prasantation ,  incraasad  aaaory  sat  aisa  alao  anhancad  subjacts' 
anargy  lavals,  although  tha  diffaranea  was  not  as  graat. 

It  is  intarasting  to  nota  hara  that  tha  Incraasad  rate  of 
prasantation  rather  than  tha  increased  sise  of  tha  aaaory  set 
affected  tha  ratings  of  stress  and  effort.  In  general  subjects 
perceived  graatar  diffarancaa  batwaan  tha  levels  of  difficulty 
for  this  task  than  for  the  tracking  task.  The  percentages  of 
variance  accounted  for  on  the  rating  scale  analyses  were  larger 
than  those  discovered  for  the  tracking  task.  The  ratings  on  the 
Attention  Level  scale  were  generally  high,  as  they  were  for  the 
tracking  task.  Siailarly  tha  ratings  on  Task  Coaplexity  and 
Physical  Effort  ware  low  ovarall. 

Auditory  Monitoring  Task »  Objactiva  Maaauras .  The  perfor- 
aance  measures  for  this  task  ware  tha  nuabar  of  correct 
responses  and  nuabar  of  wrong  or  aissad  rasponsas.  Tha  task 
daaands  ware  raLativaly  low  for  all  lavals  of  the  task;  the 
number  of  responses  required  par  ainuta  ware  either  2  or  8 
depending  on  the  condition,  whereas  the  nuabar  of  responses  ra* 
quirad  for  tha  Sternberg  aeaory  task  ware  either  20  or  40  per 
ainute  by  coaparison.  Thus,  perforaance  was  virtually  error- 
free  and  no  significant  differences  ware  found  as  a  function  of 
aaaory  load  or  prasantation  rata. 

Auditory  Monitoring  Task  t  Mating  Scales .  Tha  rata  of 
presentation  showsd  a  aignificant  affect  on  three  of  the  scales: 
Ovarall  Workload,  Attention  Level,  and  Energy  Laval.  The  faster 
rata  was  raflaetad  in  highar  ratings  on  these  scales.  Although 
there  was  no  significant  affect  for  tha  presentation  rate  on  the 
Perforaance  scale,  subjacts  paroaivad  thair  performance  as 
batter  with  tha  faster  rata  of  prasantation  (although  in  fact 
tbara  was  no  diffaranea  in  perforaance  asasuras).  Zt  is  possi¬ 
ble  that  tha  level  of  boradoa  iaposad  by  tha  slower  rata  affect¬ 
ed  tha  subjective  assassaant  of  parforaanca,  i.e.,  subjacts  felt 
they  did  batter  whan  they  bad  more  to  do. 

Tha  affect  of  aaaory  load  was  raflaetad  by  significant 
diffarancaa  on  sight  of  tha  scalast  Overall  Workload,  Perfor- 
aanca.  Training,  Motivation,  Task  Difficulty,  Task  Complexity, 
Mental  Effort,  and  Sensory  Effort.  In  all  cases  tha  higher  load 
condition  ganarally  resulted  in  highar  ratings  with  tha  excap- 
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tlon  of  Porforaonco  and  Training*  whara  tha  highar  load  raaultad 
in  a  lowar  rating.  Tha  actual  diffaraneaa  for  the  ratinga  on 
tha  Training  acala  wara  vary  alight*  but  aay  have  raflactad  a 
dasira  for  a  longar  practico  pariod  undar  tha  vaaory  load  condi¬ 
tion.  Tha  ona-ainuta  praetiea  aassion  allowed  only  two 
reaponaoB  for  aaeh  of  tha  aaaory  load  conditions  and  aay  not 
bava  baan  aufficiant.  Tha  diffaraneaa  dua  to  aaaory  load  for 
both  Mental  and  Sensory  Effort  wara  paroalved  only  under  tha 
faster  rata  of  presentation. 

Significant  intaractions  between  aaaory  load  and  rata  of 
presentation-  wara -found  for  Tiaa  Prassura «  Task  Difficulty*  and 
Mental  Effort.  For  both  Task  Difficulty  and  Mental  Effort*  sub¬ 
jects  perceived  no  diffaraneas  dua  to  aaaory  load  with  tha  slow 
rata  of  presentation.  For  tha  faster  rata*  tha  highar  aaaory 
load  was  fait  to  be  aora  difficult*  and -raquira  aora  thought* 
although  in  both  eases  tha  ratings  wara  still  below  the  SO  per 
cant  level. 

Ratings  wara  generally  low  on  tha  aajority  of  scales*  par¬ 
ticularly  on  those  of  Stress  bevel*  Tiaa  Prassuroi  Task  Diffi¬ 
culty*  and  Physical  Effort  (Figure  4).  These  ratings  accurately 
reflected  the  low  daaands  aada  by  this  task  and  tha  variance  ac¬ 
counted  for  was  again  vary  aaall  in  all  instancas. 

Tiaa  Estiaation i  Oblactiva  Measures .  Tha  ratio  of  astiaat- 
ad  or  produced  duration  to  tha  standard  duration  was  used  as  tha 
parforaanea  aaasura  for  tiaa  estiaation.  Tha  aaans  and  standard 
deviations  ware  coaputad  across  all  20  astiaatas  or  productions 
aada  by  each  subject  under  each  axpariasntal  condition.  Tha 
naan  ratios  of  astinatad  to  standard  durations  wara  significant¬ 
ly  different  (F( 1  *  1 1 )«9. 03  p<«01)  froa  tha  aaan  ratios  of  pro¬ 
duced  to  standard  durations:  tha  latter  wara  typically  greater 
than  1.0  and  tha  foraar  typically  lass  than  1.0.  Since  a  long 
production  and  a  short  verbal  astinate  both  represent  undarasti- 
nation  of  elapsed  tiaa  (Bindra  C  Waksbarg*  1956)*  tha  difference 
is  dua  to  the  sane  underlying  process.  Tha  technique  anployad 
did  not  significantly  af.'act  average  estiaation  or  production 
accuracy . 

Tha  variability  of  produced  and  verbally  astiaatad  dura¬ 
tions  was  siailari  however,  in  this  case  tha  affect  of  technique 
resulted  in  a  highly  significant  diffaranca  ( F( 1  *  1 1 )bS7. 53 
p<.0001).  Estiaatas  or  productions  aada  with  tha  counting  tech¬ 
nique  wara  auch  less  variable  than  astiaatas  aada  without  count¬ 
ing.  This  phanoaenon  occurred  both  within  and  between  subjects 
and  is  in  agraeaent  with  earlier  results  (Bird  a  Hart*  1980} 
Hart*  McPherson*  S  Looais*  1978). 

Tiaa  Estiaation :  Rating  Beales .  In  general  tha  tiaa  asti- 
aation  task  produced  very  low  ratings  on  Overall  Workload* 
Stress  Laval*  Tiaa  Prassura*  Task  Coaplaxity*  Activity  Level* 
Physical  Effort*  and  Sensory  Effort.  Thera  was  no  signif. cant 
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Figure  S.  Heen  ratings  and  significant  effects  at  or  beyond  tb 
for  oethod  (1),  tacbnlque  and  the  interaction  of  Method 


•ff«ot  for  Ovorall  Workload  on  tho  tiao  ••tiantion  task*  but  for 
tha  varbal  aatiaatlon  aathod,  whara  aubjaeta  had  to  count  aloud 
and  than  aaka  tha  aatlaata  ovar  tha  intareoa,  thara  waa  a  auch 
hiqhar  rating  than  for  any  otbar  laval,  raflactlng  tha  fact  that 
thara  waa  aora  to  L’l  thla  condition  than  in  any  othar*  Thara 
vara  aignificant  ^  i  ‘  ^  ^ .  r,  fcr  aathod  of  tiaa  aatiaation  for  thraa 
of  tha  rating  aea.'^ut  '^tcantion  Laval,  Straaa  Laval,  and  Nantal 
Effort  (Figura  5)*  ::r  evary  caaa  tha  ratinga  for  varbal  aatiaa¬ 
tion  vara  highar  thm.  lor  production,-  probably  raflactlng  a 
faallng  of  raducad  control.  Tho  duration  of  tha  tiaa  intarval 
is  eontrollad  by  tha  axpariaantar  for  varbal  aatiaation,  wharaaa 
tha  aubjact  ha'  control  of  tha  alapaad- duration-f or  production. 

Tachniqua  significantly  affaetad  four  of  tha  rating  scalass 
Farforaanca,  Attantion  Laval,  Task  Difficulty,  and  Activity  Lav¬ 
al.  Subjacts  pareaivad  thair  porforaanea  as  being  a/ich  batter 
with  counting.  In  fact,  thair  astiaatas  ware  equally  inaccurate 
ragardlaas  of  tha  technique,  but  they  vara  aora  consistent  whan 
able  to  count  aloud.  Counting  was  pareaivad  as  requiring  aora 
attantion  and  aora  activity,  as  it  in  fact  did,  but  no  counting 
waa  rated  as  being  aora  difficult  than  counting,  because  count¬ 
ing  provides  a  concrete  and  rhythaic  basis  upon  which  to  asti- 
aats  tha  passage  of  tiaa.  Although  tha  Motivation  scale  did  not 
show  a  significant  affect  for  tha  tachniqua  variable,  subjacts 
ware  generally  aora  highly  aotivatad  whan  they  wars  able  to 
count • 

Malationships  Batwaan  Bub jactiva  and  Objective  Maasuras 

txaaination  of  relationships  aaong  objsctiva  aaasuras  of 
parforaanea  and  subjactiva  ratings  and  tha  intar-ralationships 
aaong  subjactiva  ratings  was  parforaad  using  Faarson  product  ao- 
aant  corralatlon  coaf f ieiants .  Bignlficanca  levels  vara  dster- 
ainad  using  a  ons-tailad  test  with  10  degrees  of  fraadoa. 

Tha  aean  rating  scale  Intarcorralations  across  tha  four 
levels  within  each  task  ware  calculated  to  dataraina  tha  rela¬ 
tionships  within  tasks  (Table  1).  Thara  wars  no  significant  re¬ 
lationships  between  any  of  tha  subjective  ratings  and  the  ap¬ 
propriate  objaetlva  aaasuras  on  any  of  tha  four  tasks.  As  noted 
by  Moray  (1982),  this  finding  is  not  at  all  unusual.  It  nay  be 
that  subjacts  sake  allowances  for  tha  danands  of  tha  task  whan 
Baking  ratings.  If  tha  dsnands  ara  such  that  they  are  pareaivad 
as  being  beyond  reasonable  raquiraaants  than  tha  subject  nay  al¬ 
low  hiasslf  or  herself  aora  errors  but  still  consider  his  or  her 
parforaanea  or  effort  as  adequate.  Furtharsora,  the  effort  in¬ 
volved  in  naating  task  daaands  nay  ba  ineraasad  without  any  sig¬ 
nificant  changs  in  the  parcaption  of  workload,  providing  tha  ef¬ 
fort  required  ranains  witbin  the  capabilities  of  the  operator. 
Such  variables  as  tins  pressure,  aotivation,  fatigue,  physical 
state,  ate.,  all  nay  inpact  tha  operator's  ability  to  neat  the 
task  danands. 


Table  1 

Hean  rating  scale  Intercorrelations  across  the  four  levels 
within  each  of  the  four  tasks;  £<.05*,  £<.02**,  £<.01***. 
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Although  no  rolntionshlps  war*  found  botwaon  aubjaotlva 
ratinga  and  objaotlua  parforaanea  aaaauraa,  thara  vara  algnifi- 
eant  ralationahipa  aaong  tha  rating  acalaa*  Thara  waa  a  poai- 
tiva  eorralation  batwaan  ratinga  for  Ovarall  Workload  and  Straas 
Laval  for  ovary  taak»  and  for  Ovarall  Workload  and  Taak  Diffi- 
eulty  for  tha  tracking^  dtarnbarg,  and  auditory  wonitoring 
tanka.  Straaa  Laval  corralatad  poaitivaly  with  Tank  Difficulty 
on  all  four  taaka.  howovar.  tha  ratinga  for  parcalvad  atraaa  and 
difficulty  vara  both  higher  on  tha  tracking  and  dtarnbarg  taaka. 
Ovarall  Workload  corralatad  aignif icantly  with  Activity  Laval  on 
tha  tracking  and  ttarnbarg  taaka.  both  Activity  Laval  and 
Ovarall  l^rkl^d  wara  ratad  ,wucb_  higher  on  thaao  two  taaka  than 
for  aithar  the  auditory  aionitoring  or  tiwa  aatimation  taaka. 

Subjective  Parforaanca  ratinga  did  not  corralato  with  any 
other  rating  nor  with  any  objective  naaaura  of  parfornanca. 
Subjacta  rarely  rated  their  own  parfornanca  aa  being  below  tha 
50  par  cant  lavali  they  alwaya  ialt  that  thalr  parfornanca  waa 
at  laaat  adequate.  Thara  ware  virtually  no  oorralatlona  between 
aithar  Attention  Laval  or  Motivation  and  any  other  acala.  indl*- 
eating  aithar  that  thaaa  two  factora  are  unrelated  to  tha  other 
rated  dinanaiona  of  workload  or  that  thara  waa  little  variation 
within  thaaa  two  factora.  The  latter  explanation  ia  noat  likely 
aa  all  taaka  required  relatively  continuoua  attention,  thara 
wore  no  diatractors.  and  tha  taak  lavala  ware  probably 
equivalently  intaraating  (or  unintaraating) . 

Tina  Praaaura  correlated  with  Straaa  Laval  on  both  the 
taaka  for  which  tha  rata  of  praaantation  waa  nanipulatad.  tha 
Sternberg  and  auditory  nonitoring  taaka.  Mental  Sffort  ratinga 
ahowad  no  direct  ralationabip  with  Ovarall  Workload,  but  corra* 
latad  with  Straaa  Laval  for  tha  tracking  and  Sternberg  taaka. 

Tha  large  nunbar  of  corralationa  for  tha  auditory  nonitor- 
ing  taak  are  aonawhat  aurpriaing  bacauaa  tha  taak  dananda  wara 
ao  low  under  all  conditiona.  and  thara  wara  abaolutaly  no 
diffarancaa  in  parfornanca.  Thia  conbination  of  a  nonitoring 
and  nanory  lead  taak  nay  have  produced  relatively  conplax  in- 
tarralationahipa  for  tha  rating  acala  Itana  axaninad  hara.  but 
no  parfornanca  diffarancaa  could  be  aaan  bacauaa  tha  aubjacta 
wara  ao  auccaaaful  in  naatlng  all  taak  dananda  that  their  par- 
fernanoa  waa  error  free.  Thia  illuatrataa  tha  inportanca  of 
evaluating  worklead*ralatad  factora  indapandantly  fron,  and  in 
addition  to.  parfornanca,  in  order  to  gain  a  clear  understanding 
of  tha  oparator'a  axparianca. 

kalationahip  of  Taak  and  Bxparinant  Mating  Scalaa 

Tha  rating  acala  corralationa  for  all  sixteen  task  condi¬ 
tions  wara  averaged  in  order  to  correlate  tha  conbinad  ratings 
for  each  of  tha  tasks  to  those  nada  at  tha  and  of  the  entire  ax- 
parinant.  Six  of  tha  scales  wara  significantly  corralatadt 
Parfornanca  (r«.64S,  £<.05).  Training  (r*.819.  £<.01),  Attention 
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L«v«l  (£••$•$«  £<.0S),  Motivation  (r"*767,  £<«01)f  Physioal 
Stato  (r>»767«  £<.01)«  and  Taak  CoapTaxity  (r«*S92,  £<.0S). 
Ratings  on  thasa  aealas  wara  apparantly  laaa'af f aetad  by  tha 
particular  task  daasnds  and  wars  eensistant  across  tha  langth  of 
tha  axpariaant*  Bvidantly  subjocts  pareaivad  lass  variability 
batvasn  taaks  and  task  conditions  whan  asking  ratings  on  thasa 
scalas*  Pubjacts  ganarally  rated  thair  parferaanca  as  being 
aodarataly  highi  training  was  paroaivad  as  being  neither  too 
little  nor  too  auch#  tha  attention  level  required  was  always 
paroaivad  as  baing  above  tha  nid>point«  activation  was  also  re¬ 
latively  stable  at  about  tha  aid-point  or  slightly  above,  physi¬ 
cal  state.  reaainad -in -a -range,  of  60  to  6S%,  and  -task  coaplaxity 
was  rated  relatively  low  on  all  tasks* 


Tha  lowest  correlations  ware  for  tha  Activity  Laval  and 
Task  Difficulty  scalas  where  large  diffaraneas  ware  parcaivad 
between  tasks),  thus,  the  final  rating  of  the  entire  axparisant 
was  probably  an  averaged  perception  of  task  demands  which  would 
not  reflect  tha  range  originally  recorded.  Thera  is  at  least 
soee  face  validity  in  tha  results  of  this  analysis)  tasks  did 
vary  considerably  in  activity  requiranents  and  in  difficulty 
lavals.  The  low  correlations  for  tha  three  effort  scales  also 
reflect  tha  considerably  different  daeands  imposed  by  tha  dif¬ 
ferent  tasks. 

C0HCL08IOM8 

The  rating  scales  used  in  this  study  wars  not  selected  for 
the  purpose  of  producing  a  definitive  subjeetiva  workload  scale, 
but  rather  as  exploratory  probes  for  the  purpose  of  identifying 
the  factors  which  are  consistently  perceived  as  related  to  work¬ 
load  regardless  of  the  type  of  task  or  condition  imposed,  and 
those  factors  which  arc  perceived  as  task  or  condition  depen¬ 
dent  . 


The  two  tasks  that  manipulated  both  rate  of  presentation 
and  memory  load,  the  Sternberg  and  auditory  monitoring  tasks, 
demonstrated  clear  within-task  rating  scale  differences.  This 
was  particularly  striking  because  there  were  no  performance 
differences  for  the  auditory  monitoring  task,  and  only  weak  ef¬ 
fects  on  performance  for  the  Sternberg  task,  providing  further 
evidence  that  workload  and  performance  nay  not  covary.  However, 
the  different  levels  of  task  demands  for  each  task  affected  the 
rating  scale  variability  in  different  ways.  The  results  are 
consistent  with  the  fact  that  the  rate  of  presentation  and 
number  of  responses  required  were  greater  for  the  Sternberg  task 
than  for  the  auditory  monitoring  task,  loth  the  rate  of  presen¬ 
tation  and  memory  load  affected  the  perception  of  Overall  Work¬ 
load  for  both  tasks,  but  for  the  Sternberg  task  the  rate  of 
presentation  also  slgnif leant ly  affected  ratings  on  10  addition¬ 
al  scales,  compared  to  only  2  ethers  for  tb*  auditory  monitoring 
task.  Memory  load  manipulation  affeetad  7  of  the  scales  for  the 
Sternberg  task  and  •  for  the  anditory  monitoring  task  with  four 
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•e«l«s  eoBBOB  to  both;  Ovorall  Workload,  PorforBoneo,  Task  Dlf* 
floulty,  and  Task  CoBploxity* 

Tho  tracking  and  tiBo  oatiBation  tasks  showed  no  within- 
task  diffarsneas  on  tha  Owarall  Workload  rating  seala,  suggast- 
ing  that  tha  diffarantial  pareaption  of  ovarall  workload  may  ba 
dapandant  on  Bors  diserats  ▼ariatlons  of  task  doBands  such  as 
those  iaposed  by  the  dtarnbarg  and  auditory  Bonitoring  tasks. 
Tha  nuBbar  and  type  or  rasponsss  required  for  tiaa  astination 
were  held  ralatiwaly  constant  over  all  levels  of  tha  tiaa  asti- 
aation  task  and  wars  not  olaarly  discriainabla  across  tha  four 
layais  of  the  -tracking  task.  This  assuBption.  is-  supportsd  by 
tha  fact  that  a  total  of  only  5  of  tha  rating  scales  wars  af¬ 
fected  by  variations  in  task  danands  within  tha  tracking  task, 
and  only  6  of  tha  scalaa  for  tine  oatiBation,  wharaaa  for  tha 
Sternberg  and  auditory  Bonitoring  tasks,  11  and  12  of  the  rating 
aoalas  raspactivaly  dsBonstratad  within  task-dif f arancas  on  one 
or  both  task  dinansiona* 

There  ware  only  two  scalaa  that  conaistantly  damonstratad 
within-task  diffsrancast  ParforBanea  and  Task  Difficulty.  Rat¬ 
ings  on  these  scalaa  ware  generally  consistent  with  tha  dasands 
Bade  by  tha  lavala  of  tha  task,  although  tha  Porfornanca  scale 
raflactad  evaluations  that  apparently  eonbinad  both  tha  feeling 
of  success  and  sons  elaaant  of  discoafort  or  insecurity  isposad 
by  a  particular  condition.  This  was  Bost  claarly  danonstratad 
by  tha  tiBS  astiBstion  task  where  tha  no  counting  condition 
resulted  in  Buch  lower  ratings  of  parcaivad  adequacy  of  perfor- 
Banca  than  did  tha  counting  condition,  in  spite  of  the  fact  that 
there  ware  no  actual  diffarancas  in  parforsanca. 

Mental  Effort  ratings  ware  significantly  affactad  by  tha 
within-task  dasands  of  all  tasks  ascapt  tha  tracking  task,  prob¬ 
ably  baeausa  tha  daBsnds  of  tha  latter  task  ware  prisarily  lis- 
itad  to  simple  hand-aye  coordination.  Stress  Laval  ratings  ware 
affactad  only  by  tho  tracking  and  Starnbarg  tasks,  and  Tina 
Prassurs  and  Inargy  Laval  ratings  wore  affactad  only  by  those 
tasks  which  actually  Banipulatad  tha  rata  of  prasantation--tha 
Starnbarg  and  auditory  Bonitoring  tasks,  with  tho  Energy  Laval 
ganarally  enhanced  by  ineraasad  danands.  powavar,  tha  actual 
ratings  on  tha  Energy  Laval  scale  ware  higher  for  tha  two  tasks 
that  required  tha  greatest  aeasurabla  output--tha  Starnbarg  and 
tracking  tasks.  SiBilsrly,  tha  scales  that  raflactad  task 
danands  ware  also  rated  higher  than  for  tha  tine  estimation  or 
auditory  Bonitoring  tasks. 

Ratings  of  Ovarsll  Workload  always  covariad  with  stress 
Laval  ratings,  and  Stress  Laval  always  covariad  with  Task  Diffi¬ 
culty.  Ovarall  Workload  covariad  directly  with  Task  Difficulty 
for  all  tasks  sxcapt  tlBS  astination.  These  findings  are  gan¬ 
arally  concordant  with  relationships  reported  by  NoKansia 
(1979),  Stainingar  (1977),  and  others.  However,  Attention  Lav¬ 
al,  which  is  often  related  to  workload,  was  not  parcaivad  as  ba- 
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ing  r«lat«d  to  Ovortll  Norklotd  or  any  other  rating  acala  Itaa 
used  in  thia  study.  This  oould  have  oecurrad  either  as  a  ooase* 
quenoe  of  the  defiaitlen  provided  for  attention  level,  or  he* 
cause  of  the  short  duration  of  the  experinental  taaka  (tnstroa  a 
Rouse,  1977). 

Further  research  ia  planned  to  dataraina  the  effects  of  a 
nuaber  of  other  siaple  flight-related  activities  on  perceived 
«er)cload  and  other  related  factors*  Variation  in  levels  and 
types  of  aental  workload  and  other  subtle  but  relevant-to-f light 
factors  will  be_  a  aajor. .focus*  The  -inforaation  thus  obtained 
will  then  be  applied  to  the  analysis  of  different  levels  \>f  such 
tasks  when  used  as  secondary  aeasures  of  workload  for  priaary 
flying  taaka.  The  ultiaate  goal  is  to  derive  a  aatrie  senaitive 
to  the  coabined  effects  of  the  aany  coaponent  taaka  involved  in 
flying  on  pilot  workfoad. 
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ABSTRACT 


Twenty  workload  estimation  techniques  were  compared  in  terms  of  their  sen¬ 
sitivity  to  changes  In  pilot  loading  In  an  ILS  task.  The  techniques  Included 
opinion  measures,  spare  mental  capacity  measures,  physiological  measures,  eye 
behavior  measures,  and  primary  task  measures.  Loading  was  treated  as  an  Inde¬ 
pendent  variable  and  had  three  levels:  low,  medium,  and  high.  The  load  lev¬ 
els  were  obtained  by  a  combined  manipulation  of  wlndgust  disturbance  level  and 
simulated  aircraft  pitch  stability.  Six  Instrumented-rated  pilots  flew  a 
moving-base  general  aviation  simulator  in  four  sessions  lasting  approximately 
three  hours  each.  Measures  were  taken  between  the  outer  and  middle  markers. 

Two  opinion  measures,  one  spare  mental  capacity  measure,  one  physiolog¬ 
ical  taeasure,  and  one  primary  task  measure  demonstrated  sensitivity  to  loading 
in  this  expetlment.  These  measures  were; Cooper-Harper  ratings,  WCI/TE  ratings, 
time  estimation  standard  deviation,  pulse'  rate  mean,  and  control  movements  per 
unit  time.  The  Cooper-Harper  ratings,  WCI/TE  ratings,  and  control  movements 
demonstrated  sensitivity  to  all  levels  of  load,  whereas  the  time  estimation 
measure  and  pulse  rate  mean  showed  sensitivity  to  some  load  levels. 

The  results  ^  this  expei-tneo^  demonstrate  that  sensitivities  of  workload 
estimation  techniques  vary  widely,  and  that  only  a  few  techniques  appear  to  be 
sensitive  In  this  type  of  ILS  task,  which  emphasizes  psychomotor  behavior. 

INTRODUCTION 


r.V  •> 


5 


One  of  the  major  problems  In  mental  workload  estimation  Is  the  lack  of 
available  Information  on  the  sensitivity  of  various  workload  estimation  tech¬ 
niques  [1,2].  When  a  researcher  or  human  factors  engineer  needs  to  assess 
workload  In  a  given  experimental  situation,  it  Is  not  clear  which  technique 
or  techniques  should  be  used  [3].  The  danger  Is  that  Insensitive  techniques 
may  be  used.  If  so,  experimental  results  will  show  no  differences  In  work¬ 
load  when  In  fact  there  are  differences. 

Sensitivity  In  regard  to  workload  estimation  can  be  defined  as  the  rela¬ 
tive  ability  of  a  given  workload  estimation  technique  to  discriminate  statis¬ 
tically  significant  differences  In  operator  loading.  High  sensitivity  requires 
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dlscrimliiable  changes  In  the  score  means  as  a  function  of  load  level  and  low 
variation  of  the  scores  about  the  means.  When  sensitivity  is  defined  in  this 
way,  it  becomes  siibject  to  experimental  determination.  Based  on  experiments 
that  emphasise  specific  operator  behaviors,  it  should  be  possible  to  predict 
which  given  techniques  are  sensitive. 

An  experiment  directed  at  evaluating  the  sensitivity  of  workload  estima¬ 
tion  techniques  laa  psychomotor  task  has  been  completed  and  is  reported  brief¬ 
ly  in  this  paper.  An  ILS  piloting  task  was  used  for  the  evaluation.  (For  a 
more  detailed  dlscrlption  of  the  experiment  and  results,  see  reference  [4]). 


EXPERIMENT 


Subjects 

Six  male  instrument-rated  pilots  served  as  subjects  in  this  experiment. 
The  flight  time  of  the  subjects  ranged  from  500  to  2700  hours  with  a  mean  of 
1300  hours. 


Apparatus 


The  primary  apparatus  in  this  experiment  was  a  modified  flj  task  simu¬ 
lator  (Singer  Link,  Inc.,  General  Aviation  Trainer,  GAT-IB).  T  Imulator 
had  three  degrees  of  freedom  of  notion  (roll,  pitch,  and  yaw).  .ansulucent 

blinders  were  used  to  cover  the  windows  of  the  simulator  to  re  e  outside 

distractions  and  cues  and  to  aid  in  the  control  of  cockpit  illumination. 


Several  modifications  to  the  flight  simulator  were  made  for  the  experi¬ 
ment.  These  iBodific  .cions  permitted  primary  task  load  manipulation,  secondary 
Cask  operations,  rec*'''nse  measurement,  and  scoring.  Primary  task  load  manip¬ 
ulation  was  accomplished  by  changing  aircraft  pitch  stability  and  random  wind- 
gust  disturbance  level  simultaneously.  Three  load  conditions  were  developed: 
low,  medium,  and  high,  as  shown  in  Table  1.  Table  2  provides  a  list  of  the 
workload  measurement  techniques  selected  for  inclusion  in  the  present  study. 


Experimental  Design 

A  complete  3  x  20  withln-subject  design  was  used  for  the  sensitivity  anal¬ 
ysis.  Load  was  the  factor  with  three  levels.  Measurement  technique  (Table  2) 
was  Che  factor  with  twenty  levels. 


Workload  measures  from  different  techniques  were  taken  simultaneously  on 
some  of  the  data  collection  runs.  Only  those  measures  which  were  not  likely 
to  affect  each  other  were  taken  simultaneously.  Table  3  shows  the  scheme  used 
for  combining  different  measurement  techniques  for  data  collection.  The  com¬ 
bination  of  measurement  techniques  shown  in  Che  table  was,  to  an  extent,  based 
on  previous  Investigations  of  workload.  Hicks  and  Wlerwllle's  (3]  study  sup¬ 
ported  the  coid>inatlon  In  condition  2.  The  two  rating  scales  were  administered 
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In  separate  meaauremeat  conditions  to  prevent  the  ratings  on  one  scale  from 
biasing  the  ratings  on  the  other  scale.  The  secondary  task  measures  were  dl' 
vlded  among  several  conditions  because  of  potential  Intrusion  and  interference. 
Vocal  measures  were  recorded  from  the  two  secondary  tasks  which  required  a 
verbal  response  as  per  Schlflett  and  Loikith's  [5]  recommendation. 

It  should  be  noted  that  primary  task  measures  were  recorded  on  all  sub¬ 
jects  and  on  all  data  collection  flights  for  the  Intrusion  analysis.  However , 
only  data  from  measurement  condition  1  were  used  for  the  sensitivity  analysis 
-  of  the  primary  task  measures. 


General  Procedure 


After  receiving  instructions,  subjects  flew  nine  familiarization  flights 
In  the  simulator.  These  flights  were  similar,  but  not  the  same  as,  the  data 
collection  flights.  All  subjects  flew  the  familiarization  flights  in  the  same 
order.  Steady  crosswinds  were  introduced  for  each  run,  and  subjects  were 
given  heading  corrections. 

After  the  f£uttlliarizatlon  session,  the  subjects  participated  in  three  data 
collection  sessions.  The  familiarization  session  and  each  data  collection  ses¬ 
sion  were  held  on  a  different  day. 

Each  data  collection  session  consisted  of  two  sets  of  a  warm-up  practice 
flight  and  three  data  collection  flights.  The  practice  flight  was  the  same  as 
the  first  data  collection  flight.  Since  the  data  collection  flights  were  coun¬ 
terbalanced,  equal  amounts  of  practice  were  provided  for  the  low,  medium,  and 
high  lead  conditions.  The  data  collection  flights  also  contained  steady  cross- 
wind  conditions,  for  which  the  subject  was  given  heading  corrections.  The  pur¬ 
pose  of  Introducing  steady  crosswinds  was  to  disguise  the  load  conditions, 
thereby  requiring  subjects  to  fly  each  flight  as  a  separate  entity. 


Flight  Task  Procedures 

The  flight  task  in  this  experiment  was  an  ILS  approach  in  the  Singer  Link 
GAT-IB  aircraft  simulator.  Prior  to  the  beginning  of  a  flight,  the  simulated 
aircraft  was  positioned  on  the  ground  5  miles  outbound  from  the  outer  marker  on 
the  108  degree  radial,  heading  into  the  wind.  When  ready  to  begin,  the  experi¬ 
menter  Informed  the  subject  of  the  wind  direction  and  speed,  and  gave  him  a 
heading  correction  for  the  crosswind.  When  contacted  by  the  experimenter,  the 
subject  took  off  and  climbed  to  2000  feet.  The  subject  then  flew  directly  to 
the  outer  marker  by  following  the  localizer  at  100  miles  per  hour  until  the 
glide  slope  was  intercepted.  Upon  interception  of  the  glide  slope,  the  subject 
reduced  airspeed  to  80  miles  per  hour  and  proceeded  down  the  glide  slope  while 
following  the  localizer  to  a  landing.  Data  were  recorded  between  the  outer  and 
middle  markers.  For  the  opinion  measures,  subjects  gave  ratings  for  the  flight 
segment  between  the  outer  and  middle  markers  Immediately  after  landing  and  park¬ 
ing  the  simulated  aircraft. 
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RESULTS 


The  computed  scores  for  each  technique  were  first  converted  to  Z-scores 
(normalised  scoros)  so  that  technique  measure  units  would  not  affect  the  sen¬ 
sitivity  analysis.  Subsequently,  an  overall  analysis  of  variance  was  perform¬ 
ed  on  the  scores.  Since  Z-scores  were  used,  a  technique  main  effect  was  not 
possible.  A  significant  main  effect  of  load  was  found,  (2,10)  ■  5.34, 

£  <  0.0001,  and  a  significant  load  by  technique  Interaction  was  found, 

F  (38,190)  -  2.76,  p  ^  0.05. 

The  load  by  technique  Interaction  Indicated  that  the  measurement  tech¬ 
niques  were  differentially  sensitive  to  load.  Therefore,  Individual  AMOVAs 
were  used  to  Isolate  the  sensitive  techniques. 

The  Individual  ANOVAs  Indicated  that  five  of  the  twenty  measures  were 
sensitive.  They  were  the  Cooper-Harper  scale  (2,10)  «  16.39,  £  ■  0.0007; 
the  Workload-Compensation- Interference/Technical  Effectiveness  (SCI/TE)  scale, 
(2,10)  >  31.15,  £  <  0.0001;  the  time  estimation  standard  deviation,  F  (2,10) 

■  5.69,  £  ■  0.022;  the  pulse  race  mean,  F  (2,10)  ■  8.89,  £  ■  0.006;  and  the 
control  movements  measure,  F  (2,10)  ■  33.34  £  <  0.0001.  The  normalized  means 
for  each  technique  are  plotted  in  Figures  1  through  5  as  a  function  of  load. 

Newman-Keuls  comparisons  were  then  performed  on  the  normalized  means  of 
the  sensitive  measures.  The  comparlslons  included  low  vs.  medium,  medium  vs. 
high,  and  low  vs.  high  load  conditions.  Results  indicated  that  all  differences 
were  significant  at  £  <  0.05,  except  for  pulse-rate  mean  (low  vs.  medium  and 
medium  vs.  high)  and  time  estimation  standard  deviation  (low  vs.  high). 

A  logical  classification  of  techniques  based  on  demonstrated  sensitivity 
was  generated  from  an  examination  of  the  Newman-Keuls  comparisons,  as  shown 
in  Table  4.  Techniques  which  demonstrated  sensitivity  to  all  pairs  of  load 
conditions  (l.e.,  low  vs.  medium,  medium  vs.  high,  and  low  vs.  high)  were  in¬ 
cluded  In  class  I.  These  measures  are  preferred  over  other  techniques  which 
demonstrated  only  partial  sensitivity,  or  no  sensitivity  In  the  present  study. 
Techniques  which  showed  sensitivity  to  some  differences  In  load  conditions 
(but  not  all)  were  Included  In  class  II.  These  measures  are  less  preferred 
than  class  I  techniques,  but  are  more  preferred  than  class  III  techniques. 

Class  III  techniques  did  not  demonstrate  sensitivity  to  load  In  the  present 
study.  This  class  includes  all  techniques  except  those  In  class  I  and  class 
II. 


One  possible  reason  that  only  five  of  the  twenty  workload  assessment 
techniques  demonstrated  sensitivity  In  the  present  study  Is  that  the  other 
techniques  simply  required  a  greater  number  of  subjects  to  show  a  significant 
effect  of  load.  It  Is  possible  to  estimate  the  sample  size  required  to  detect 
a  reliable  load  effect  for  a  given  workload  assessment  technique  at  specified 
levels  of  significance  and  power.  These  calculations  were  performed  for  tech¬ 
niques  which  did  not  demonstrate  sensitivity  in  the  present  study,  to  provide 
an  Indication  of  the  practical  costs  of  achieving  statistical  significance. 

The  procedure  used  for  estimating  the  sample  size  required  for  finding  sensl- 
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tlvlty  Is  described  by  Bowker  and  Llebernan  [6].  Sample  slses  were  estimated 
for  a  significance  level  of  0.05  and  for  a  power  of  approximately  0.80.  The 
results  of  these  estimates  are  presented  In  Table  S. 


CONCLUSIONS 

This  study  has  shown  that  five  measures  of  %rorkload  estimation  were  sen¬ 
sitive  Indicators  of  load  in  a  piloting  task  chat  Is  predominantly  psychomotor 
In  nature;  Another  fifteen  measureSf  believed  to  be  "good"  measures  of  work¬ 
load,  showed  no  reliable  effect.  The  main  conclusion  that  must  be  drawn  from 
the  study  Is  that  few  measures  are  sensitive  to  navchomotor  load. 

Of  the  five  techniques  demonstrating  sensitivity,  only  three  exhibited 
monotonlc  score  Increases  with  load  as  well  as  statistically  reliable  differ¬ 
ences  between  all  pairs  of  load  levels.  Consequently,  only  the  three  meet  all 
criteria  for  sensitivity  to  psychomotor  load.  These  class  I  technique?  are  the 
ones  that  are  recommended  for  measurement  of  psychometor  load: 

Cooper /Harper  ratings, 

WCI/TE  ratings,  and 

Control  movements  per  second. 

The  other  two  techniques  showed  sensitivity  to  psychomotor  load,  but  did  not 
discriminate  between  all  pairs  of  load  levels.  These  class  II  techniques  are: 

Time  estimation  standard  deviation,  and 

Pulse  rate  mean. 

These  measures  would  be  helpful  In  evaluating  psychomotor  load,  but  they  should 
not  be  relied  on  exclusively.  At  least  one  class  I  technique  should  also  be 
ised  In  conjunction  with  these  measures. 

It  Is  wortli  noting  that  only  two  opinion  measures  were  taken  In  the  present 
experiment,  and  both  proved  sensitive.  This  suggests  that  well-designed  rating 
scales  are  among  the  best  of  techniques  for  evaluating  psychomotor  load.  In 
regard  to  the  primary  task  measures,  the  control  movements  meacure  alone  was 
sensitive.  However,  this  measure  Is  also  the  only  primary  task  measure  which 
reflected  "strategy"  of  the  pilot.  Consequently,  one  could  speculate  that  se¬ 
lecting  a  primary  task  measure  that  reflects  strategy  will  most  likely  result 
In  gooa  sensitivity. 

Fifteen  (techniques)  measures  showed  no  reliable  change  as  a  function  of 
load.  When  these  fifteen  measures  were  subjected  to  a  power  analysis  to  deter¬ 
mine  sample  size,  the  number  of  subjects  required  ranged  from  12  to  well  over  100 
(Table  5).  One  can  only  conclude  that  at  best  the  fifteen  measures,  as  taken, 
are  much  less  sensitive  to  psychomotor  load  than  the  five  appearing  In  Classes  I 
and  II.  Of  course,  there  Is  always  the  possibility  that  the  measures  would  be 
sensitlvlte  to  loading  along  other  dimensions  of  hu  i  performance,  such  as 
psychomotor  tasks  of  a  different  nature,  or  medlatli  lal  or  cognitive  tasks,  for 
example . 
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In  general,  the  results  of  the  experiment  show  that  there  are  wide  vari¬ 
ations  In  the  senslvlty  of  workload  estimation  measures.  Great  care  must  be 
taken  In  selecting  measures  for  a  given  experiment.  Otherwise,  It  Is  possible 
that  no  changes  In  workload  will  be  found,  when  Indeed  there  are  changes. 
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PITCH  STABILITY 

a.  ConCrol  Input  to  pitch 
rate  output  aqulvalant 
gain  (degreaa/a  per  X 
of  control  range) 

b.  Control  input  to  pitch 
rate  output  equivalent 
time  constant (a) 


LOAD  CONDITION 


Low  Medium 

Low  Medium 

0  2.7 


High 


Medium 


A* 


TABLE  2 


Workload  Assessment  Techniques  Which  Were  Tested  in  the 
Present  Experiment 


OPINION 

1 .  Cooper-Harper  Scale 

2.  WCI/TE  Scale 

SPARE  MENTAL  CAPACITY 

3.  Digit  Shadowing  (%  errors) 

4.  Memory  Scanning  (Mean  time) 

5.  Mental  Arithmetic  (%  errors) 

6.  Time  Estimation  Mean  (Seconds) 

7.  Time  Estimation  Standard  Deviation  (Seconds) 

8.  Time  Estimation  Absolute  Error  (Seconds) 

9.  Time  Estimation  RMS  error  (Seconds) 

PHYSIOLOGICAL 

10.  Pulse  Rate  Mean  (Pulses  per  minute) 

11.  Pulse  Rate  Variability  (Pulses  per  minute) 

12.  Respiration  Rate  (Breath  cycles  per  minute) 

13.  Pupil  Diameter  (Normalized  units) 

14.  Voice  Pattern  (Digit  Shadowing  Task) 

15.  Voice  Pattern  (Mental  Arithmetic  Task) 

EYE  BEHAVIOR 

16.  Eye  Transition  Frequency  (Transitions  per  minute) 

17.  Eye  Blink  Frequency  (Blinks  per  minute) 

PRIMARY  TASK 

18.  Localizer  RMS  Angular  Position  Error  (Degrees) 

19.  Glide  Slope  RMS  Angular  Position  Error  (Degrees) 

20.  Control  Movements  per  second 

(Aileron  +  Elevator  +  Rudder) 


Cooper-Harper  Scale 
Pupil  Diameter 
Eye  Transition  Frequency 
Eye  Blink  Frequency 
Localizer  RMS  Error 
Glide  Slope  RMS  Error 
Control  Movements 


WCI/TE  Scale 
Pulse  Rate  Mean 
Pulse  Rate  Variability 
Respiration  Rate 


Digit  Shadowing 
Voice  Pattern 


11.  •  >i,‘« 


Memory  Scanning 


Mental  Arithmetic 
Voice  Pattern 


Time  Estimation 
(Mean) 

(Std,  Dev.) 
(Abs.  Error) 
(RMS  Error) 


TABLE  4 

Logical  Clasalflcatlon  of  Techniques 
Based  on  Demonstrated  Sensitivity 


Class  I:  Complete  Sensitivity  Demonstrated 
Cooper-Harper  Scale 
WCI/TE  Scale  -  -  -  - 

Control  Movements /Unit  Time 

Class  Hi  Some  Sensitivity  Demonstrated 
Time  Estimation  Standard  Deviation* 

Pulse  Rate  Mean** 

Class  111:  Sensitivity  Not  Demonstrated 
All  Other  Techniques  (See  Table  S) 


*Double  valued  function 
**Limlted  sensitivity 


TABLE  5 

Estimated  Sample  Sizes  Required  for  Achieving  a  Significant 
Load  Effect  for  Techniques  not  Demonstrating  Sensitivity 


Technique  Estimated  Sample  Size 


SPARE  MENTAL  CAPACITY 


Digit  Shadowing 

18 

Memory  Scanning 

>100 

Mental'  Arithmetic 

25 

Time  Estimation  (Mean) 

53 

Time  Estimation  (Abs.  Error) 

>100 

Time  Estimation  (RMS  Error) 

53 

PHYSIOLOGICAL 

Pulse  Rate  Variability 

45 

Respiration  Rate 

15 

Pupil  Diameter 

>100 

Speech  Pattern  (D.  Shadow.) 

28 

Speech  Pattern  (M.  Arlth.) 

>100 

EYE  BEHAVIOR 

Eye  Transition  Frequency 

42 

Eye  Blink  Frequency 

25 

PRIMARY  TASK 

Localizer  RMS  Error  12 

Glide  Slope  RMS  Error  41 

12 

41 


Figure  1.  Mean  normellced  scores  for  the  Cooper-Harper  rating  scale  measure 
plotted  as  a  function  of  load. 


sm  «i«i 

9 


Figure  2.  Mean  normallted  scores  for  the  MCI/TE  rating  scale  measure  plotted 
as  a  function  of  load. 


} 

I  Figure  3.  Mean  normalized  ecorea  for  the  time  estimation  standard  deviation 

measure  plotted  as  a  function  of  load. 
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ABSTRACT 


for 

18th  ANNUAL  CONFERENCE  ON  MANUAL  CONTROL 


Title  of  Paper:  Development  of  a  G-Seat  Roll-Axis  Drive 
Algorithm 

-Authors:  Edward-A. -Martin  (ASD/ENETS,  W-PAFB,  OH,  255-4408) 
and  Grant  R.  McMillan  (AFAMRL/HEF,  W-PAFB,  OH,  255- 
3325) 


The  paper  reports  the  design  and  evaluation  of  a  g-seat  drive 
algorithm  developed  in  preparation  for  a  comparison  of  g-seat 
versus  whole-body  roll-axis  cuing.  Force  transducers  were 
used  to  measure  pressures  on  the  buttocks  during  roll  motion  in 
the  Advanced  Low  Cost  G-Cuing  System  (ALCOGS)  and  the  Roll-Axis 
Tracking  Simulator  (RATS) .  The  tests  were  conducted  under  a 
range  of  amplitude  and  frequency  conditions.  The  results 
indicated  that  pressures  in  the  ALCOGS  are  a  function  of  seat 
pan  roll  amplitude.  In  the  RATS  (a  whole-body  motion  simu¬ 
lator)  pressures  varied  as  a  function  of  roll  amplitude  and 
roll  acceleration.  Using  these  data,  a  drive  equation  was 
developed  for  the  ALCOGS  that  produces  buttocks  pressures 
similar  to  the  RATS.  This  drive  equation  was  then  evaluated 
in  a  pilot  study  which  compared  human  performance  on  a 
disturbance  regulation  task  under  a  static  condition  and  under 
motion  conditions  in  the  two  simulators. 
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OoniJensation  For  Tijne  Delays  In 
Pli^t  Simulator  Visueil  Display  ^^tems 


0.  FRANCIS  CRANE 
NASA,  ;tenes  Bssearch  Center 
Moffett  Field,  California 


Ihere  is  a  trend  toward  the  use  of  oonputer-generatod  imagery  (CGI)  systems  to 
generate  fli^t  siJiulator  out-of-the-wlndaw  visual  scenes.  CGI  visual  systems 
offer  iapartant  advantages  including  large  field-of-view,  large  gaming  area, 
nultiple-obeerver  viewpoint,  and  moving  targets.  CGI  ^tems  construct  a 
visual  display  from  a  description  of  the  scene  stored  in  a  ccn^xiter.  Ihe  image 
construction  time,  though  short  ( ~100  msec) ,  introduces  a  delay  into  the 
pilot-aircraft  system.  Several  authors  (Gun  ar^d  AJhery  1977;Larson  and  Terry 
1975)  have  reported  slnulation  problems  traced  to  time  delays  in  visual  system 
cueing.  The  nultl-  million  dollar  simulator  evaluated  by  Decker  (1980)  was 
rated  unsatisfactory  for  training  pilots  to  perform  precision  flic^it  tasks  -  at 
least  in  part  because  of  CGI  delays. 

A  piloted  aircraift  can  be  viewed  as  a  closed-loop  man-machine  control  systan. 
Mten  a  pilot  is  performing  a  precisicn  neneuver  in  a  simulator,  a  lielay  in  the 
visual  display  of  aircraft  response  to  pilot-oontxol  li^put  decreases  the 
stability  of  the  pilot-aircradft  system.  The  less  stable  system  is  more 
difficult  to  control  precisely.  Pilot  dfe^namic  response  and  perfcacmance  change 
as  the  pilot  atta:t¥)ts  to  compensate  for  the  decrease  in  system  stability.  The 
changes  In  pilot  dynamic  response  and  performance  bias  the  simulation  results 
by  influencing  the  pilot's  rating  of  the  handling  qualities  of  the  slitulated 
aircraft.  (Crane  1980) . 

An  j^iproach  to  display-delay  ocmpensation  based  on  conventional  control  system 
design  principles  was  evaluated  in  an  eeurlier  stuc^  (Qrane  1981) .  In  that 
study,  the  pilot's  task  was  to  maintain  precise  attitude  control  in  simulated 
turbulent  atmospheric  conditions  -  a  small  CRT  displayed  attitixis  information 
to  the  pilot.  The  compensation  was  effective  in  that  delay-induced  changes  in 
pilot  performanoe  and  dynamic  response  were  substantially  reduced  (Crane  1981) . 
The  display-delay  compensation  approach  was  re-ev2d.\aated  in  a  simulation 
vheroin  helicopter  pilots  performed  a  precision  attitude  control  task  using 
ce\ly  visual  cues  from  a  OGI  display.  The  design  and  preliminary  results  of 
this  just  completed  studty  are  described. 
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ABSTRACT 

yk  collision  avofdance  manoeuvre ^1n  which  drivers  were  required  to 
successfully  around  a  suddenly  appearing  obstruction  In  the 

vehicle's  path/was  Investigated.  Both  an  Instrumented  automobile  and  a 
matching  fixed  base,  computer  generated  Image  simulator  were  employed. 
Driver  performance  and  the  simulator's  validity  In  representing  an  extreme 
lateral  manoeuvre  are  examined. 


INTRODUCTION 


Variations  of  the  linear  model  of  a  human  controller  (McRuer,  Kendel, 
1973)  have  been  applied  with  some  success  to  various  driving  scenarios. 
Using  a  fixed  base  simulator  It  has  been  demostrated  (Reid,  Graf,  Billing, 
1980a),  that  for  a  simple  driving  task  In  which  drivers  were  required  to 
maintain  lane  position  while  manoeuvring  along  a  serpentine  roadway,  that 
driver  behavior  can  be  represented  In  the  average  sense  using  a  linear 
model.  The  technique  was  extended  (Reid,  Graf,  Billing  1980b)  to  model 
driving  response  for  an  extreme  lateral  control  task.  That  Is,  one  In 
which  subjects  were  required  to  respond  to  a  suddenly  appearing  obstacle 
In  the  vehicle's  path  by  steering  around  It.  Data  obtained  from  a  fixed 
base  simulator  was  again  used  to  validate  the  model  with  relative  success. 
Although  good  fits  to  the  experimental  data  were  obtained,  the  resultant 
model  parameters  were  not  always  Intuitively  satisfying  sometimes  having 
values  that  either  seemed  to  have  the  wrong  magnitude  or  sign.  Another 
experiment  In  which  the  collision  avoidance  was  modelled  (Maeda,  Irle, 
Hidaka  and  Nishimura)  Involved  automobile  data  for  model  verification  and 
also  yielded  good  model  fits  to  the  data. 


The  current  Investigation  of  linear  modelling  techniques  involved  an 
experiment  to  generate  data  In  both  an  automobile  and  a  matching 
fixed-base,  computer  generated  Image  driving  simulator.  The  availability 
of  data  for  both  vehicles  allows  the  validity  of  the  simulator  In 
eliciting  driver  response  for  the  collision  avoidance  manoeuvre  to  be 
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determined.  If  the  simulator  Is  valid  In  Its  representation  of  the 
automobile  for  this  type  of  manoeuvre,  then  It  may  be  unequivocally  used 
as  a  tool  to  validate  collision  avoidance  driver  models.  However,  the 
nature  of  the  task  with  extreme  lateral  motions,  and  the  absence  of 
acceleration  cues  and  limited  visual  fidelity  of  the  simulator  render 
suspect  Its  ability  to  ellcite  the  same  driver  behavior  as  the  automobile. 
The  present  paper  discusses  the  results  of  the  experiment,  addressing 
simulator  validity  for  the  collision  avoidance  manoeuvre  and  driver 
behavior  In  performing  the  manoeuvre. 


EXPERIMENT 


The  collision  avoidance  scenario  was  as  follows.  The  task  was  to 
maintain  lane  position  via  the  steering  wheel  while  driving  under  cruise 
control  at  50  kilometers  per  hour  down  either  lane  of  a  two  lane  divided 
highway  with  no  other  cars  present.  The  shoulder  of  the  lane  In  which  the 
subject  was  driving  was  lined  with  poles  at  regular  20  metre  Intervals. 

The  poles  could  be  remotely  triggered  to  fall  In  front  of  an  approaching 
vehicle  and  cover  80%  of  the  established  lane  thereby  creating  an 
obstruction  (figure  1).  A  successful  collision  avoidance  manoeuvre 
required  the  drivers  to  miss  the  obstruction  by  steering,  and  only 
steering  (no  braking).  Into  the  adjacent  lane  and  then  returning  as 
rapidly  as  possible  to  the  original  lane  without  striking  either  lane's 
shoulder.  Varying  degrees  of  urgency,  or  severity  of  the  manoeuvre  were 
created  by  varying  the  preview  distance  ahead  of  the  approaching  vehicle 
at  which  the  unknown  obstructing  pole  would  begin  to  fall.  In  less  severe 
cases  the  falling  pole  was  Identified  for  the  driver  or  even  left 
completely  down  to  represent  an  obstruction  with  no  surprise  element. 

Subjects  were  required  to  drive  both  the  automobile  and  simulator  on 
alternate  days  throughout  a  one  month  period  during  which  the  experiment 
was  conducted.  On  consecutive  days  however,  one  for  the  automobile  and 
one  for  the  simulator,  the  same  task  was  driven. 

The  test  track  (figure  2)  was  laid  out  on  a  flat,  straight  one  kilometer 
roadway  with  the  centre  520  metres  lined  with  27  potentially  obstructive 
poles.  The  roadway  centre  line  was  represented  by  a  continuous  4  Inch 
white  line  and  the  far  shoulder  identified  by  a  series  of  cones.  This 
scene  was  chosen  because  it  could  be  readily  simulated  using  the  available 
vector  display  system  of  the  simulator  (figure  3).  The  solid  centre  line 
on  the  track  was  required  to  facilitate  the  optical  lane  tracking  system 
used.  The  simulator's  display  centre  line  however  was  represented  by  a 
dashed  line  to  provide  some  textural  visual  information. 

The  automobile  (figure  4)  employed  was  a  compact  North  American  sedan. 
Instrumention  featured  an  on-board  POP  11/03  with  2  floppy  discs  for  data 
acquisition  as  well  as  two  lane  trackers,  one  facing  forward  u 'd  one 
backward,  to  permit  the  accurate  determination  of  automobile  lane  position 
and  heading  angle  at  all  times  throughout  the  experiment.  This  was 
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parti cularlly  critical  during  the  actual  collision  avoidance  manoeuvre 
when  the  vehicle  made  significant  excursions  In  both  lane  position  and 
heading  angle  from  nominal  lane  tracking  values. 

The  driving  simulator  (figure  5)  Is  fixed  base  with  a  large  screen 
vector  refresh  display.  The  equations  of  motion  are  linear  with 
parameters  either  determined  experimentally  or  supplied  by  the 
manufacturer.  The  tire  model  was  non-linear  due  to  the  extreme  nature  of 
collision  avoidance  tasks.  Subjects  adjusted  well  to  the  simulator  with 
no  111  side- effects- and  all  concurred  In  a  post  experiment  questional  re 
that  the  simulator  was  an  accurate  representation  of  the  actual  driving 
task. 


EXPERIMENTAL  PROCEDURE 


Eight  subjects  with  driving  experience  ranging  from  6  to  11  years  were 
selected  from  12  drivers  solicited  at  the  Institute  for  Aerospace  Studies. 
The  dv'lvers  were  all  graduate  students  whose  ages  fell  In  the  mid  to  late 
twenties  range.  One  subject  dropped  out  of  the  experiment,  and  due  to 
time  constraints  could  not  be  replaced,  leaving  seven  subjects.  For  their 
participtlon  In  the  experiment  subjects  were  paid  a  fee  of  $50.00  plus  an 
added  incentive  pay  of  $.50  for  each  successful  run  completed  and  a 
penally  charge  of  $2.50  levied  for  each  unsuccessful  manoeuvre. 

The  procedure  (summarized  In  Table  1)  consisted  of  three  fundamental 
phases;  transfer  of  learning,  training,  and  production  runs.  During  the 
transfer  of  learning  phase  the  subjects  were  divided  Into  two  equal 
groups.  This  grouping  was  based  on  a  questional  re  completed  by  the 
subjects  regarding  their  driving  experience.  Group  1  commenced  the 
experiment  In  the  simulator  doing  an  obstacle  avoidance  manoeuvre  for  the 
case  where  the  pole  location  was  unknown  and  the  preview  distance,  defined 
as  the  distance  ahead  of  the  approaching  vehicle  at  which  the  unknown  pole 
would  begin  to  fall,  set  at  52  metres  .  The  following  day,  the  same  task 
was  performed  In  the  automobile.  The  third  day,  again  In  the  simulator, 
the  collision  avoidance  manoeuvre  was  performed  with  a  32  metre  preview 
followed  on  the  forth  day  by  the  same  task  performed  In  the  automobile. 
Group  2  performed  the  same  tasks,  except  that  the  order  of  the  vehicles 
was  reversed,  1e  Group  2  began  the  experiment  with  the  automobile.  The 
training  phase  of  the  experiment  Imposed  no  specific  vehicle  order  of 
presentation  to  the  subject,  except  that  a  task  performed  for  the  first 
time  In  either  vehicle  had  to  be  repeated  on  the  following  day  In  the 
alternate  vehicle.  The  subjects  were  trained  In  stages  for  manoeuvres  In 
both  directions  and  with  varying  ('agrees  of  severity.  In  ascending  order 
of  severity  the  different  cases  were: 

fixed  obstacle  -  a  pole  was  down  and  remained  down  throughout  the  run.  No 
surprise  element. 

designated  obstacle  -  the  falling  pole  was  Identified  by  placing  a  marker 

cone  beside  It.  The  preview  distance  which  could  be 
1  of  2  cases  (  52  or  32  metre  )  was  revealed  to 
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the  subject.  Little  surprise  element  since  subject 
knew  location  of  pole. 

emergency  case  >  the  obstructing  pole  was  unknown  to  the  subject.  It  was 
always  either  a  52  or  a  32  metre  preview.  Most  severe  of 
the  manoeuvres  although  It  was  not  a  complete  surprise  as 
subjects  would  anticipate  an  event. 

—  At  the  completion  of  the  training  phase  all  subjects' were  con^etent  In 
handling  either  the  automobile  or  the  simulator  for  the  varying  tasks. 

The  production  runs  required  subjects  to  perform  In  a  random  order  the 
fixed  obstacle  case,  the  emergency  case,  and  another  case  during  which  no 
pole  falling  event  took  place.  Thus  the  final  scenario  for  the  production 
runs  was  one  of  driving  along  a  roadway,  with  the  potential  for  an 
emergency  to  occur,  or  an  obstructing  hazard  might  be  constantly  present, 
or  no  event  at  all  occurs. 

ANALYSIS  and  RESULTS 


Data  was  recorded  at  the  rate  of  10  Hz  In  the  automobile  and  20  Hz  In 
the  simulator  for  a  total  of  30  seconds  during  each  run.  This  Interval 
was  centered  around  the  time  that  the  vehicle's  centre  of  gravity  (C  of 
G)  passed  the  obstructing  pole.  Sample  plots  for  a  typical  32  metre 
preview  of  the  emergency  type  are  given  In  figure  6.  The  manoeuvre  was 
one  that  required  going  from  an  established  path  In  the  right  lane  to  the 
left  lane  In  order  to  avoid  striking  the  obstacle.  Lane  position  Is  the 
lateral  position  of  vehicle's  C  of  G  with  respect  to  the  roadway  centre 
line.  Positive  being  to  the  right.  Heading  angle  was  with  respect  to  the 
centre  line  as  well,  with  the  clockwise  sense  as  viewed  from  above  being 
positive.  A  positive  steering  wheel  angle  causes  a  positve  yaw  rate  In 
the  same  sense  as  the  heading  angle.  The  vertical  bar  on  the  time  axis  at 
approximately  the  13  seconds  mark  represents  the  time  when  the  obstructing 
pole  began  Its  fall. 

Performance  parameters  for  the  collision  avoidance  manoeuvre  were 
calculated  from  the  recorded  time  histories  for  each  run.  These 
parameters,  with  their  definitions  are  listed  In  table  2.  Table  3 
contains  parameter  values  averaged  over  all  subjects  for  the  emergency 
manoeuvres  performed  during  production  runs.  Analysis  of  the  data  was 
done  using  the  TTEST  procedure  of  the  Statistical  Analysis  System  (SAS). 
Differences  in  the  analysis  were  required  to  be  significant  to  the  level 
p  <.05  and  substantial,  1e  greater  than  experimental  errors,  before  they 
were  accepted. 

Validation  of  the  simulator  In  Its  ability  to  represent  the  automobile 
for  the  collision  avoidance  manoeuvre  was  sought  within  the  contexts  of 
transfer  of  learning,  absolute  similitude,  and  relative  similitude. 

Transfer  of  Learning 

As  an  a  posteriori  check  on  the  equality  of  driving  ability  between  the 
two  groups  of  subjects  formed  for  the  transfer  of  learning  phase,  their 
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performance  during  production  runs  was  compared  for  the  same  typ®s  of  runs 
employed  during  the  transfer  of  learning.  It  was  found  (table  4,  with 
condition  equal  to  .. ./PROLUCTION)  that  although  the  two  groups  were 
similar  with  respect  to  their  performance  in  the  automobile.  Group  2  which 
started  training  in  the  automobile,  exhibited  a  more  sluggish  response  in 
the  simulator  than  did  Group  1.  This  is  evidenced  by  longer  steering 
wheel  rise,  delay,  peak,  and  damping  times.  Significant  and  substantial 
effects  (table  4,  wHh  condition  equal  to  .../TRANSFER)  not  disqualified 
by  this  aromali.ty  still  indicate  that,  transfer  of  learning  did  occur. 

Group  2  had  a  20t  longer  response  time  and  a  i4S  greater  steering  wheel 
angle  peak  in  the  automobile  f!>r  the  52  metre  preview  case  than  did  Group 
I  which  had  prior  training  in  the  simulator.  Group  2  exhibited  a  greater 
number  of  steering  wheel  reversals  in  the  simulator  than  did  Group  1  for 
both  the  52  and  32  metre  preview  cases. 

Absolute  Similitude 

Comparing  the  subjects  performance  in  both  the  automobile  and  the 
simulator  for  all  the  production  run  experimental  cases  yielded  the 
following  results  (see  table  5).  With  respect  to  vehicle  motion,  the 
simulator  exhibited  a  20%  greater  maximum  heading  angle  deviation  for  all 
cases.  The  distance  over  the  center  line  was  also  greater  for  the 
simulator  in  all  but  the  right  emergency  manoeuvres.  The  difference  was 
about  65  cm  which  represented  quite  a  substantial  deviation  (65%)  from  the 
automobile  equivalent.  Steering  wheel  activity  showed  differences  as 
well.  The  number  of  reversals  was  30%  greater  for  the  simulator,  but  only 
for  right  manoeuvres.  The  rise,  delay  and  peak  times  were  all  greater  for 
the  subjects  in  the  simulator  for  the  32  metre  preview  cases,  although  the 
simple  response  time,  or  time  to  react  to  the  initial  appearance  of  the 
obstructing  pole  was  not  significantly  different  between  the  automobile 
and  simulator. 

Relative  Similitude 

Table  6  lists  the  differences  in  performance  between  the  varying 
experimental  cases.  The  Designated  vs  Fixed  and  Emergency  vs  Fixed 
comparisons  do  not  include  time  parameters  (T  RES...T  OAl^)  because  In 
the  fixed  obstruction  case  the  pole  is  always  down  and  doesn't  have  an 
associated  trigger  time  thereby  rending  ^ese  parameter  indeterminate. 

The  Designated  vs  Emergency  and  52m  vs  32m  preview  comparisons  do  Include 
all  the  performance  parameters. 

The  Designated  vs  Fixed  case  exhibited  a  30%  greater  path  deviation  and 
a  26%  greater  heading  angle  deflection  for  the  designated  obstacle  case. 
This  difference  observed  for  the  automobile  was  not  present  for  the 
simulator.  This  same  trend  occured  for  the  Emergency  vs  Fixed  comparison 
in  which  the  emergency  obstacle  case  exhibited  a  30%  greater  path 
deviation  and  a  20%  greater  heading  angle  deflection. 

Comparing  the  designated  and  emergency  cases  yielded  only  a  single 
significant  difference.  The  response  time  to  the  falling  obstacle  was  35% 


longer  for  the  emergency  case  but  only  for  the  simulator  32  metre  preview 
case. 

The  52  vs  32  metre  preview  comparison  showed  the  heading  angle  greater 
by  20f  and  the  steering  wheel  peak  greater  by  40%  for  the  32  metre  preview 
In  the  automobile  only.  However,  for  both  the  automobile  and  simulator, 
the  time  parameters  T  RES,  T  DELAY,  T  PEAK,  T  SPARE  and  T  DAMP  were 
substantially  longer  for  the  52  metre  case.  The  differences  In  T  RES,  T 
DELAY  and  T  PEAK  being  quite  large,  1e  150%,  100%  and  78%  larger 
rqspectlvelyv 

DISCUSSION 

Although  there  existed  some  Inate  differences  between  the  assigned 
groups  In  the  transfer  of  learning  phase,  a  transfer  of  learning  was 
exhibited.  For  subjects  trained  first  In  the  simulator  on  the  52  metre 
preview  case  and  then  followed  by  the  automobile,  a  positive  transfer 
occured  In  the  T  RES  performance  parameter.  That  is,  response  was  quicker 
to  the  falling  pole  than  for  the  group  with  no  previous  training.  Also, 
positing  that  a  smaller  steering  wheel  peak  Is  associated  with  a  lower 
work  ouput  and  hence  more  desirable,  a  postive  transfer  occured  for  SW 
PEAK  as  well  since  the  simulator  trained  group  exhibited  smaller  steering 
wheel  peak  angles  In  their  automobile  performance.  These  effects  however 
did  not  occur  for  the  second  part  of  the  transfer  of  learning  when 
subjects  were  required  to  perform  a  32  metre  preview  avoidance  manoeuvre. 

A  possible  explanation  might  be  that  subjects  required  no  extra  training 
having  adapted  directly  to  the  more  severe  32  meter  case  based  only  on 
practise  of  the  52  metre  case  In  both  the  automobile  and  simulator. 

Another  transfer  effect  was  exhibited  although  It  was  negative  .  The 
group  transfering  from  the  automobile  to  the  simulator  demonstrated  a 
greater  number  of  steering  wheel  reversals  In  the  simulator.  Thus  It 
would  seem  that  caution  must  be  exercised  «dten  switching  from  a  high 
fidelity  system,  the  automobile,  to  one  with  less  fidelity,  the  simulator 
-  lacking  In  acceleration  cues,  peripheral  vision  cues  and  visual 
textural  cues. 

In  the  context  of  absolute  similitude  there  was  no  signficant  difference 
In  subject  response  time  (T  RES)  between  the  car  and  simulator.  This 
suggests  that  all  the  cues  required  or  utilized  by  the  driver  In  detecting 
the  obstacle  were  well  represented  In  the  simulation.  The  simulator 
trajectory  demonstrated  greater  perterbatl ons  (as  determined  by  D  OVER  C 
and  PSI  MAX)  than  did  the  automobile.  Since  the  simulator  visual  Image 
and  hood  outline  were  calibrated  to  represent  a  perfect  perspective  view 
of  the  actual  automobile's  hood  and  roadway  scene  the  conclusion  drawn  Is 
that  In  the  absence  of  acceleration  cues,  the  visual  display  system  with 
Its  limited  field  of  view  and  textural  cues  was  not  sufficient  to  allow 
the  subject  to  control  the  simulator  trajectory  In  the  same  absolute 
manner  as  the  automobile.  The  number  of  steering  wheel  reversals  for  both 
left  and  right  manoeuvres  In  the  automobile  was  the  sariie.  The  simulator 
however  showed  a  greater  number  of  reversals  for  the  right  manoeuvre  than 
the  left.  The  right  manoeuvre  required  that  on  returning  to  the  original 
lane  after  avoiding  the  obstacle  the  subject  realign  the  vehicle's  path 
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using  roadway  cues  from  the  left  lane  edge.  This  unfamlllarlty  of  driving 
with  respect  to  the  left  lane  edge  combined  with  the  limited  visual  and  no 
lateral  acceleration  cues  might  account  for  the  Increase  In  the  number  of 
steering  wheel  reversals. 

Ar\y  parameter  that  shows  good  absolute  similitude  should  also  exhibit  a 
good  relative  similitude.  This  was  the  case  with  the  response  time.  T  RES 
was  approximately  1  second  longer  for  ^e  52  metre  case  than  the  32  metre 
case  for. both  manoeuvre  directions  and  both  vehicles.  In  comparing  the 
Designated  vs  Emergency  cases  T  RES  was  significantly  shorter  for  the 
simulator  designated  32  metre  preview  case.  No  difference  was  exhibited 
between  the  designated  and  emergency  cases  for  the  automobile.  The 
shorter  response  time  for  the  designated  case  In  the  simulator  may  be  an 
Indication  of  a  premature  steering  response  based  on  an  Improper 
estimation  of  vehicle  position  due  to  the  lack  of  sufficient  depth  of 
field  Information  from  the  visual  display.  It  Is  not  an  Indication  of 
better  performance  since  It  was  not  exhibited  In  the  automobile.  Good 
relative  similitude  was  also  exhibited  between  the  52  metre  and  32  metre 
cases  for  steering  activity,  1e  T  DELAY,  T  PEAK,  T  SPARE  and  T  DAMP  were 
all  greater  for  the  52  metre  case  In  both  vehicles. 

Designated  vs  Fixed  and  Emergency  vs  Fixed  comparisons  yielded  similar 
results,  as  was  to  be  expected  since  the  designated  and  emergency  cases 
differred  only  In  the  T  RES  parameter  which  as  mentioned  previously  cannot 
be  calculated  for  the  fixed  obstacle  case.  The  maximum  heading  angle  and 
the  distance  over  the  centre  line  was  less  for  the  fixed  case  than  for  the 
other  two  cases.  This  however  was  true  only  for  the  automobile.  Thus  for 
the  differing  degrees  of  task  severity,  the  simllator  responses  exhibit 
the  same  degree  of  clearance  whereas  In  the  automobile  the  least  severe  of 
the  three  manoeuvres  Is  performed  with  a  greater  degree  of  confidence  and 
an  associated  smaller  safety  margin. 

It  was  noted  that  subjects'  control  strategy  differred  between  the  52 
and  32  metre  cases.  The  32  metre  case  required  prompt  steering  responses. 
However  the  52  metre  case  gave  a  sufficient  time  latitude  for  subjects  to 
make  decisions  and  change  their  control  technique.  Although  this  was  not 
anticipated  by  the  experimenters  It  Is  Interesting  to  note  that  D  OVER  C, 

T  OVER  C  and  AY  MAX  were  not  different  between  the  two  manoeuvres,  and 
the  longer  response  time  for  the  52  metre  case  placed  the  vehicle  close  to 
the  point  where  the  pole  would  be  triggered  If  It  were  a  32  metre  preview 
case  .  This  Indicates  that  subjects  changed  their  control  strategy  for 
the  52  metre  case  In  such  a  way  that  It  appeared  like  an  avoidance 
manoeuvre  for  the  32  metre  case. 

Summary  and  Conclusions 

In  comparing  driver  obstacle  avoidance  performance  In  an  automobile  and 
a  fixed  base,  computer  generated  Image  driving  simulator  the  following  was 
observed: 


Transfer  of  Learning 

1)  positive  transfer  from  sInHjIator  to  automobile  occurred  for  time  to 
respond  to  Initially  falling  obstructing  pole  and  maximum  steering 
peak  angle. 

2)  negative  transfer  from  automobile  to  simulator  occurred  for  the  number 
of  steering  wheel  reversals. 

Absolute  Sense 


1)  during  the  obstacle  avoidance  manoeuvre  simllator  trajectories  made 
greater  excursions  than  did  the  automobile's. 

2)  the  number  of  steering  wheel  reversals  exhibited  during  the  obstacle 
avoidance  manoeuvre  was  greater  In  the  simulator  for  right  manoeuvres 
only. 

3)  steering  wheel  activity  In  manoeuvring  to  avoid  an  obstacle  was  more 
sluggish  In  simulator  than  automobile  for  32  m  preview. 

4)  time  required  to  respond  to  Initial  falling  of  obstructing  pole  was 
not  significantly  different  between  vehicles. 

Relative  Sense 

1)  time  required  to  respond  to  Initial  falling  of  obstructing  pole  showed 
good  relative  similitude  between  52  and  32  metre  preview  cases.  It 
did  not  exhibit  relative  similitude  be^en  the  designated  and 
emergency  obstruction  cases. 

2)  steering  wheel  acitivlty  characteristic  times  (T  DELAY,  T  PEAK,  T 
SPARE  ,  T  DAMP)  exhibited  good  relative  similitude  between  52  and  32 
metre  preview  cases. 

Manoeuvre  Severity 

1)  during  obstacle  avoidance  manoeuvre  simulator  trajectories  exhibited 
no  difference  between  fixed,  designated  or  emergency  cases. 

Automobile  trajectories  for  the  fixed  case  however  ,  showed  smaller 
excursions  than  did  the  designated  or  emergency  cases.  Mo  difference 
for  automobile  trajectories  was  noted  between  disignated  and  emergency 
cases. 

2)  time  to  respond  to  Initially  falling  pole  was  longer  for  emergency 
than  designated  case  for  simulator  32  metre  preview  case  only. 

3)  subjects  modified  their  control  strategy  between  52  and  32  metre 
preview  cases  In  such  a  manner  that  the  vehicle  trajectory  of  the  52 
metre  case  approximated  that  of  the  32  metre  case. 

Conclusions 

The  simulator  exhibited  good  absolute  and  relative  similitude  as  well  as 
postive  transfer  of  learning  for  the  T  RES  parameter.  This  however  does 
not  constitute  simulator  validity  for  the  collision  avoidance  manoeuvre 
since  the  reponse  time  parameter  Is  not  specific  to  the  task  of  lateral 
control  of  the  vehicle.  Except  for  the  relative  validity  of  the  steering 
wheel  activity  time  parameters  and  subjective  opinion  of  the  drivers  no 
strong  evidence  supports  the  validity  of  the  fixed  base  simulator  In 
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representing  an  autocnobUe  for  a  lateral  collision  avoidance  manoeuvre. 
This  lack  of  validity  does  not  however  preclude  the  simulator's 
usefulness  as  a  tool  In  studying  extreme  cases  of  lateral  control.  Driver 
modelling  techinques  applied  to  simulator  behavior  In  an  attempt  to  fine 
tune  or  correct  them  for  lack  of  simulator  fidelity  may  facilitate  the 
prediction  of  automobile  performance.  This  Is  the  direction  of 
Investigation  currently  being  undertaken. 
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EXPERIMENTAL  PROCEDURE 


TRANSFER  Of  LEARNING  -  2 

groups 

Day 

1  2 

3 

4 

GROUP  1 

SIM  52  AUTO  52 

SIM  32 

AUTO  32 

(48 

runs  per  subject) 

GROUP  2 

AUTO  52  SIM  52 

AUTO  32 

SIM  32 

(48 

runs  per  subject) 

TRAINING  -  Alternating  between  automobile  and  simulator  on  consecutive 
days. 


-  6  d^ys 

•  52  and  32ffl  preview,  right  manoeuvre  (24  runs  per  subject) 

•  fixed  obstacle,  no  surprise  (32  runs  per  subject) 

•  designated  obstacle,  subject  was  Informed  as  to  location  of  obstacle 

and  degree  of  'surprise*  (16  runs  per  subject) 


PRODUCTION  RUNS  -  Alternating  between  automobile  and  simulator  on 

consecutive  days. 

-  4  days 

-  52,  32,  fixed  obstacle,  and  blank  (no  obstructing  event)  runs  In 
random  order  and  both  directions  (54  runs  per  subject). 


TABLE  1 


Performance  Parameters 


D  OYER  C  •>  (distance  over  the  centre  line)  maximum  lateral  distance  that 
vehicle  C  of  6  goes  past  the  roalway  centre  line. 

T  OYER  C  -  (time  over  centre  line)  time  tt^at  the  vehicle  C  of  G  Is  In  the 
adjacent  lane. 

AY  MAX  -  (lateral  acceleration  maxi  urn)  absolute  value  of  the  maximum 
lateral  acceratlon  Incurred  during  the  manoeuvre. 

PSI  MAX  -  (heading  angle  maximum)  absolute  value  of  the  maximum  heading 
angle  incurred  during  a  manuoeuvre. 

SW  MAX  -  (steering  wheel  maximum)  absolute  value  of  the  maximum  heading 
angle  Incurred  during  the  manoeuvre. 

SW  PEAK  -  (steering  peak)  absolute  magnitute  of  the  first  steering  wheel 
response  after  obstructing  pole  In  triggered. 

SW  RYSL  -  (steering  wheel  reversals)  number  of  times  that  the  steering 
wheel  rate  changes  sign.  Counting  starts  at  the  time  when  the 
steering  wheel  hits  the  value  of  10%  of  the  Initial  response 
peak  and  finishes  when  the  RMS  value  falls  below  the 
pre-emergency  RMS  value. 

T  RES  -  (time  of  response)  time  taken  by  the  subject  to  respond  to 

falling  pole.  Starting  time  Is  when  pole  Is  triggered, 
finishing  time  Is  where  the  tangeant  line  to  the  10%  and  90% 
points  of  the  Initial  steering  response  crosses  the  time  axis. 

T  RISE  (rise  time)  time  taken  for  Initial  steering  response  to  go 
from  10%  to  90%  of  Initial  peak. 

T  DELAY  -  (delayed  time)  time  taken  for  Initial  steering  response  to 
reach  50%  of  Initial  peak  from  time  of  falling  pole  trigger. 

T  PEAK  -  (time  to  peak)  time  taken  for  Initial  steering  response 

to  reach  Its  peak  value  from  time  of  falling  pole  trigger. 

T  SPARE  -  (time  to  spare)  time  between  first  steering  response  to  reach 

Its  peak  value  from  time  of  falling  pole  trigger. 

T  DAMP  -  (time  to  damp)  time  from  trigger  time  of  falling  pole  until 

steering  wheel  activity  fall  below  pre-emergency  RMS  value. 

SW  RATE  -  (steering  wheel  rate)  slope  of  tangeant  through  10%  and 
90%  points  of  Initial  steering  wheel  response  peak. 


TABLE  2 


AVOIDANCE  MANOEUVRE  PERFORMANCE  PARAMETERS 
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FIGURE  4  INSTRUMENTED  VEHICLE  DURING 
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INTRODUCTION 

< 

The  ^velopment  of  engineering  requirements  for 
man-in-the-loop  simulation  is  a  complex  task  involving  numerous 
trade-offs  between  simulation  fidelity  and  costs,  accuracy  and 
speed,  etc.  The  principal  issues  confronting  the  developer  of  a 
simulation  involve  the  design  of  the  cue  (motion  and  visual) 
environment  so  as  to  meet  simulation  objectives,  and  the  design  of 
the  digital  simulation  model  to  fulfill  "^h#^  real-time  requirements 
with  adequate  accuracy. 

In  specifying  the  cue  environment  the  designer  roust  establish 
the  ne*^  for  particular  ^es  as  well  as  the  requisite  fidelity  for 
their  presentation.  Thc^hoices  Iwadc  -her^  are  important  because 
the  validity  and  utility  of  the  resulting  simulation  can  be 
critically  dependent  upon  them  and  because  the  decisions  involve 
major  costs  of  the  simulation.  Unfortunately,  these  decisions  ar^ 
difficult  to  arrive  at  rationally,  inasmuch  as  the/^iu>lcee^ 
depend  on  con^lex  psychological  as  well  as  engineering  factors.  — ' 
The  requirements  will  be  governed  by  the  purpose  of  the  simulation; 
training  simulators  have  different  needs  than  research  simulators. 
They  will  also  be  problem  dependent  (e.g.,  the  need  for  motion  cues 
in  the  analysis  of  aircraft  control  in  a  gusty  environment  will 
depend  on  the  gust  response  of  the  aircraft) .  Finally,  the 
capabilities  of  the  adaptive  human  controller  both  help  and 
r^ompound  the  problem.  The  human  pilot  may  be  able  to  compensate 
for  simulator  shortcomings  and  maintain  system  performance; 
however,  this  could  result  in  negative  transfer  in  a  training 
environment  or  reduced  acceptability  of  the  device  or  an  Incorrect 
evaluation  in  a  research  simulation. 


The  design  of  the  simulation  model  has  become  increasingly 
important  and  difficult  as  digital  computers  play  a  more  central 
role  in  the  simulations.  The  need  for  an  adequate  discrete 
simulation  is  also  related  closely  to  the  cue  generation  problem 
inasmuch  as  the  errors  and^  in  particular,  the  delays  introduced  by 
the  simulation  will  be  present  in  the  information  cues  utilized  by 
the  pilot. 

"Past  experience,"  open  loop  measurements,  and  subjective 
feedback  from  pilots  are  all  helpful  in  developing  the  engineering 
requirements  for  simulators.  However,  for  simulations  in  which  the 
operator's  principal  task  is  flight  control,  analytic  models  for 
the  pilot/vehicle  (simulator)  system  can  be  very  useful.  Such 
models  allow  quantitative  examination,  in  a  closed-loop  context,  of 
the  (inevitable)  tradeoffs  in  simulator  design,  prior  to  commitment 
to  prototype  or  full  scale  development.  The  design  of  elements  or 
algorithms  to  compensate  for  simulator  shortcomings  can  also  be 
facilitated  by  modelling  of  this  type.  The  models  can  serve  as 
insightful  ways  of  looking  at  and  compressing  empirical  data  so 
that  it  can  be  extrapolated  to  new  situations.  Finally,  the 
parameters  of  an  analytic  model  may  prove  to  be  sensitive  measures 
of  operator  performance  and  adaptation. 

The  potential  value  of  analytic  models  in  the  simulator  design 
and  evaluation  process  has  been  recognized  in  recent  years  and 
several  development  efforts  have  been  undertaken.  Of  particular 
relevance  to  the  work  described  here  are  several  recent  studies 
involving  application  of  the  Optimal  Control  Model  (OCM)  for 
pilot/vehicle  analysis.  Baron,  Muralidharan  and  Klelnman  (1) 
developed  techniques  for  using  the  OCM  to  predict  the  effects  on 
performance  of  certain  simulation  model  design  parameters,  such  as 
integration  scheme,  sample  rate,  data  hold  device,  etc.  The  model 
was  applied  to  a  relatively  simple  air-to-air  tracking  task  and 
showed  significant  sensitivity  to  several  parameters.  Model 
results  were  later  compared  with  data  from  an  experimental  study  of 
Ashworth,  McKissick  and  Parrish  (2)  and  the  agreement  was  very 
encouraging  (Baron  and  Muralidharan  [3]). 

Tn  another  study  (4] ,  the  OCM  was  used  to  examine  the 
closed-loop  consequences  in  a  helicopter  hover  task  of  the 
performance  limitations  associated  with  a  computer  generated  image 
visual  system  «nd  a  six-degree  of  freedom  motion  system.  The  hover 
task  was  linearis'd  and  decoupled  into  separate  longitudinal  and 
lateral  control  tasl.s.  Performance/workload  effects  of  these 
simulation  elements  were  analyzed  by  incorporating  elaborated 
sensory  perception  sub-models  in  the  OCM.  The  model  results 
suggested  that  simulator  def iclen''ie8  of  a  reasonable  fiature  (by 


current  standards)  could  result  in  substantial  performance  and/or 
workload  infidelity  with  respect  to  the  task  in  flight. 
Unfortunately,  there  were  no  corresponding  experimental  data  to 
confirm  or  deny  these  predictions. 

Finally,  we  mention  the  brief  study  of  Baron  [5]  to  integrate 
the  earlier  efforts  into  a  Multi-Cue  OCM  and  to  apply  the  resulting 
model  to  analyze  effects  of  control  loader  dynamics  and  a  g-seat 
cues  on  the  air-to-air  tracking  problem  investigated  earlier  [11 . 
The  results  of  this  study  have  been  partially  validated  empirically 
but  further  -definition  of .  the  propr iocept iye  model  appears 
necessary.  The  Multi-Cue  model  described  by  Baron  [5]  provides  the 
analytic  basis  for  the  current  ln;j^^igiLt ion. 

>  This  paper  describes  the  a{>plication  of  the  Multi-Cue  OCM  to 
the  analysis  of  data  obtained  in^,4«-7eK^ee-in>en^t> study  oi  simulated 
helicopter  hove^,[61  .  The  goal  was  to  demonstrate  that  the  model 
could  be  used  to^analyze  or  predict  the  effects  of  simulator 
changes  in  a  complex  flight  control  task.  Thus,  to  a  degree,  the 
investigation  complements  the  earlier  studies  which  were  either 
completely  analytic  or  involved  data  from  relatively  simple  control 
tasks.  It  is  worth  mentioning  that  this  study  is  of  broader 
interest  than  the  simulation  context  because  of  the  opportunity  to 
con(>are  model  results  with  data  in  what  appears  to  be,  in  certain 
ways,  the  most  complex  steady-state  control  task  modelled  by  the 
OCM. 


Section  2  of  the  paper  describes  the  particulars  of  applying 
the  Multi-Cue  OCM  to  the  specific  task  being  investigated.  Model 
predictions  are  then  compared  with  experimental  data  in  Section  3. 
The  last  section  summarizes  the  results  and  presents  concluding 
remarks. 


APPLICATION  OP  OCM  TO  SIMULATED  HOVER  TASK 

In  this  section,  the  task  considered  in  the  experimental 
simulation  study  is  summarized  briefly.  (A  more  detailed  review  of 
this  study  is  beyond  the  scope  of  this  report  but  may  be  found  in 
Ricard,  et  al  [6]).  Then,  the  representation  and  specification  of 
the  task  and  pilot  in  the  OCM  framework  are  described. 

GENERAL  TASK  DESCRIPTION 

The  experiment  was  designed  to  examine  the  effects  on  hover 
control  of  motion  cues  (as  provided  by  a  motion  platform  or  g-seat) 
and  of  delays  in  the  generation  of  visual  cues.  The  simulated 


fli9^^ask  corresponded  to  maintaining  a  'Huey  Cobra  helicopter  in 
a  high  hover  relative  to  a  ship  moving  at  15  knots. ^^-The  desired 
hover  position  was  fifty  feet  from  the  ship  in  line  with  a  diagonal 
deck  marking  and  at  a  mean  height  of  twenty  feet  above  the  deck. 
The  helicopter  was  subjected  to  turbulence  modelled  by  Dryden  gust 
spectra  appropriate  to  an  altitude  of  forty  feet.  Motions  of  the 
deck  of  the  ship  could  also  be  simulated  and  the  presence  or 
absence  of  such  ship  motion  was  an  experimental  variable. 

The  data  collected  were  rms  values  or  tracking  errors 
(rail-railf  bow-stern  and  height),  helicopter  pitch  and  roll  and 
positions  of  controls  (collective,  pitch  and  roll  cyclic,  and 
rudder  pedal). 

MODEL  SPECIFICATION 

To  analyze  the  task  with  the  OCM,  we  must  specify  system 
dynamics,  disturbances,  displays  (including  cues),  a  performance 
objective  and  the  assumed  pilot  limitations.  Each  of  these  is 
discussed  below. 


System  Dynamics  and  Disturbances 


A  linearized  set  of  equations  of  motion  for  the  Huey  Cobra,  in 
state-variable  format  (Equation  2.1),  was  provided  by  Sperry 
Support  Services,  NASA-LRC  [7]  .  These  equations  were  obtained  from 
the  full  nonlinear  system  simulation  by  means  of  a  special  program 
designed  to  develop  such  linear  models  [8]. 


Because  of  the  15  knot  sideslip,  decoupling  of  lateral  and 
longitudinal  helicopter  motions  did  not  appear  to  be  justified 
(this  was  later  verified)  .  In  addition,  it  did  not  seem 
appropriate  to  ignore  the  helicopter  rotor  dynamics.  Thus,  the 
basic  equations  of  motion  involved  seventeen  state  variables: 
three  positions  (relative  to  the  deck)  and  three  linear  velocities 
(in  body  axes) ,  three  body  angular  rates  and  attitude  angles;  and 
five  states  describing  the  rotor  dynamics.  Twelve  additional  state 
variables  were  required  to  model  the  stability  augmentation  system 
(SAS)  of  the  helicopter.  The  state  equations  used  in  this  analysis 
are  given  in  Baron  [9]  . 


Dryden  gust  spectra  were  used  to  model  the  turbulence 
environment.  In  particular,  the  vehicle  body  axis  gust 
disturbances  ug,  Vg  and  Wg,  were  generated  by  passing  white  noise 
through  filters  so  as  to  yield  gust  spectra  appropriate  to  the 
forty  foot  altitude  and  fifteen  knot  airspeed  of  the  helicopter. 
The  rms  Intensity  levels  of  the  gusts  Ug,Vg  and  Wg  were  5  ft/sec,  5 
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ft/sec  and  1.42  ft/sec,  respectively.  The  state-variable  models 
for  the  gusts  are  given  in  Baron  [9];  five  state  variables  are 
needed  to  model  the  three  gusts. 


In  the  experimental  study,  ship  motion  in  each  of  the  pitch, 
roll  and  heave  axes  was  modelled  by  the  sum  of  four  sine  waves. 
These  inputs  drove  g-seat  bladders  upon  which  the  ship  model  was 
mounted.  It  is  theoretically  possible  to  duplicate  these  inputs 
exactly  but  this  would  require  twelve  more  state  variables. 
Furthermore,  it  would  be  necessary  to  conduct  a  very  careful 
analysis  of  the  amplitudes  of  the  motion  as  seen  through  the  visual 
display  system  in  order  to -model  the  effects  of  this  ship  motion 
precisely.  For  this  analysis  a  much  simpler  approach  was  used. 
Only  heave  of  the  deck  was  considered  and  this  was  modelled  by 
passing  white  noise  through  a  second  order  filter;  the  parameters 
of  this  filter  were  selected  so  that  the  autocorrelation  of  this 
input  matched  that  of  the  heave  motion  input  used  in  the 
simulation.  The  rms  level  of  the  input  used  for  this  study  was  set 
at  3.5  feet,  corresponding  to  the  five  foot  maximum  heave  of  the 
landing  pad  reported  by  Ricard  [6]. 

In  the  OCM  analysis,  ship  movement  was  treated  as  a  "display" 
disturbance;  i.e.,  it  was  added  to  the  pilot's  perception  of 
vertical  error  relative  to  the  landing  pad.  The  pilot's  assumed 
objective  was  to  maintain  the  helicopter's  position  relative  to  the 
mean  position  of  the  deck. 

When  the  coupled  vehicle  dynamics,  the  rotor  dynamics,  the  SAS 
and  the  gust  and  ship  motion  disturbances  are  all  included,  there 
are  36  state  variables  needed  to  model  the  "system"  and  environment 
(34  states  for  the  case  of  no  ship  motion).  Moreover,  this  does 
not  even  include  any  state  variables  to  account  for  simulator 
dynamics  or  human  sensory  dynamics.  This  is,  to  our  knowledge,  a 
significantly  larger  problem  than  any  previously  treated  with  the 
OCM  and,  indeed,  required  modification  of  existing  analysis 
programs  to  accommodate. 

Simulator  and  Perceptual  Models 

Detailed  descriptions  of  the  motion  and  visual  systems 
employed  in  the  helicopter  simulation  are  described  in  Ricard,  et 
al  [6] .  Because  of  the  complexity  of  the  basic  problem,  as  noted 
above,  these  systems  were  approximated  in  the  simplest  fashion 
possible.  In  particular,  it  was  assumed  that  any  dynamics 
associated  with  motion  cueing  or  sensing  could  be  neglected.  It 
was  also  assumed  that  differential  delays  between  motion  and  visual 
cues  could  be  neglected.  These  two  assumptions  were  made  to  avoid 
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the  necessity  of  having  to  introduce  additional  state  variables. 
The  assumption  concerning  the  dynamics  associated  with  motion 
cueing  and  sensing  has  proven  :o  be  reasonable  in  several  previous 
studies.  The  assumption  conce.ning  the  differential  delays  is  less 
tenable,  particularly  when  adcitional  delay  is  added  to  the  visual 
channel.  Nonetheless,  as  we  will  see  later,  these  assumptions 
appear  quite  adequate  with  reupect  to  capturing  much  of  what  is  in 
the  data. 

Thus,  we  treat  the  cue  generation  and  perception  problem  on  an 
informational  level;  i.e.,  we  determine  what  control  related 
information  is  available  from  the  various  cues  and  the 
corresponding  perceptual  limitations  (mainly  delay  and  thresholds). 

The  total  delays  for  the  various  cues  reported  by  Ricard,  et 
al.  [6]  (including  sampling  and  computational  delays)  are  77  ms  for 
the  WS  motion  platform,  82  ms  for  the  g-seat  and  62~69  ms  for  the 
visual  display.*  We  assumed  an  "average"  delay  of  70  ms  for  all 
cues. 


The  visual  display  provided  a  view  of  the  ship,  the  horizon 
and  a  dimly  lit  Head-Op  Display  (HOD)  to  provide  position  reference 
information,  otherwise  denied  by  a  limited  field  of  view  (48^  by 
26®).  The  TV  display  had  a  resolution  of  9  minutes  of  arc  (.15®). 
It  was  assumed  that  from  this  external  view  display,  the  pilot 
could  obtain  both  position  information  (relative  to  the  landing 
pad)  and  attitude  information.  As  is  normally  the  case  in  applying 
the  OCM,  it  was  also  assumed  that  rates  of  change  of  these 
variables  could  also  be  perceived. 

Visual  thresholds  for  the  various  variables  were  computed 
using  the  method  described  in  Baron,  Lancraft  and  Zacharias  [4]. 
These  calculations  are  based  on  an  analysis  of  the  potential  cues 
and  depend  on  the  geometry  of  the  situation  and  on  tlie 
discrimination  and/or  resolution  capabilities  of  the  human 
controller  and  of  his  equipment.  In  this  case,  the  resolution 
limit  of  the  display  (.15®)  is  greater  than  that  determined  for 
human  trackers  in  previous  studies  (.05®),  so  that  it  was  used  for 
resolution-determined  thresholds.  The  geometric  factors  of 
importance  are  field  of  view  and  distance  from  and  above  the  object 
being  used  to  obtain  the  cue.  The  values  of  the  visual  thresholds 
determined  from  this  analysis  are  given  in  Table  1. 


*  tfhe  visual  delays  were  different  for  translation  (62  ms)  and 
rotation  (69  ms) . 
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Table  1. 


PERCEPTUAL  THRESHOLDS* 


Variablm 

Viaual 

Motion  Platform 

G-Seat 

X,  ft 

1.68 

— 

X,  ft/MC 

.72 

— 

— 

y.  ft 

.07 

— 

— 

y,  ft/sec 

.30 

— 

— 

*.  ft 

.74 

— 

— 

s .  f t/iec 

.34 

— 

— 

a  ,  ft/»ec^ 

X  2 

a  ,  ft/aec 

.053 

.053 

.0636 

y  2 

a^,  ft/aec 

“ 

.053 

— 

deg 

.15 

-- 

" 

i (p) ,  deg/sec 

.6 

2.5 

3.0 

.  2 

p,  deg/sec 

.41 

.49 

6 ,  deg 

.15 

— 

e  <q) ,  deg/sec 

.6 

3.6 

4.3 

q,  deg/aec^ 

— 

.67 

.80 

1(1,  deg 

.15 

— 

— 

ii(r),  deg/aec 

.6 

4.2 

— 

r,  deg/aec^ 

.41 

An  entry  of  —  maans  that  it  ia  assumed  that  no 
information  on  the  variable  ia  provided  by  the 
modality 


The  motion  platform  was  assumed  to  provide  the  pilot  with 
linear  accelerations  (axrayraz)  and  body  angular  rates  and 
accelerations  (p^q^r  and  Thresholds  for  perception  of 

these  variables  were  based  on  the  values  given  in  Baron^  Lancraft 
and  Zacharias  [6]  and  are  listed  in  Table  1. 

The  g-seat  was  assumed  to  provide  the  pilot  with  surge 
acceleration  and  with  pitch  and  roll  rates  and  accelerations. 
Perceptual  thresholds  for  this  type  of  cueing  have  not  been 
measured,  but  it  was  felt  that  the  g-seat  did  not  provide  cues  as 
faithfully  as  the  motion  platform.  Therefore,  thresholds  for 
g-seat  cues  were  arbitrarily  set  to  be  20  per  cent  higher  than  for 
the  corresponding  thresholds  for  platform  motion  Indicated  in 
Table  1. 


Performance  Criteria 


The  application  of  the  OCM  requires  specification  of  a 
quadratic  cost  function.  This  involves  specifying  the  variables  to 
be  considered  and  the  weightings  associated  with  those  variables. 
The  weightings  can  be  associated  with  allowable  deviations  or  with 
human  subjective  criteria  or  limitations.  Rerer  because  there  was 
no  opportunity  to  discuss  performance  objectives  with  the  pilots, 
we  made  somewhat  arbitrary  initial  assumptions  concerning  allowable 
deviations  and  then  adjusted  them  via  a  brief  preliminary 
sensitivity  analysis  to  obtain  reasonable  agreement  with  the  data 
for  the  fixed  base,  no  added  delay,  no  ship  motion  condition.  The 
weights  were  then  fixed  for  the  rest  of  the  analysis.  The  output 
and  control  variables  included  in  the  cost  functional  along  with 
the  corresponding  deviations  and  weightings  resulting  from  the 
preliminary  analysis  ere  listed  in  Table  2.  Though  not  shown  in 
Table  2,  the  cost  functional  also  included  control  rate  terms  whose 
weightings  were  chosen  to  yield  a  "neuroraotor"  response  lag  of  Tjj  = 
.1  second  in  each  control  channel. 

Other  Model  Parameters 

The  remaining  model  parameters  to  be  specified  are  the 
operator's  time  delay  and  observation  and  motor  noise/signal 
ratios.  We  assumed  a  basic  pilot  delay  of  .2  seconds  and  a  motor 
noise/signal  ratio  of  -25  dB;  these  values  are  typical  of  those 
obtained  in  basic  tracking  experiments  and  have  been  used  in 
numerous  other  applications. 

To  specify  the  observation  noise,  we  must  choose  a  base  value 
for  noise/signal  ratio,  Pj^,  and  an  attention-sharing  algorithm.  We 
assume  a  value  of  Pj^  of  .04  (i.e.,  -14  dB)  for  all  information 
variables,  regardless  of  source.  This  value  is  higher  than  that 
associated  with  simple  laboratory  tasks  in  which  operators  receive 
extensive  feedback  and  motivation  and  train  to  asymptotic 
performance.  We  believe  the  higher  noise  ratio  is  probably  more 
appropriate  for  the  experimental  conditions  and  problem  complexity 
being  analyzed  here. 

We  assume  no  attention-sharing  between  modalities  or  within 
the  motion  and  proprioceptive  modalities.  Within  the  visual 
modality,  we  assume  that  the  pilot  shares  attention  equally  among 
the  six  basic  informational  variables  (position  errors  and  vehicle 
attitudes) . * 


*  As  is  normally  the  case  in  applying  the  OCM,  it  is  assumed  that 
no  diversion  of  attention  is  required  to  obtain  the  rate  of  change 
of  a  quantity  from  the  same  indication  or  cue  as  the  quantity 
itself. 


193 


7 


MODEL-DATA  COMPARISONS 


Twelve  experimental  condltiona  were  Investigated  for  the  main 
sxper imental  variables  of  motion  cueingr  visual  delay  and  ship 
movement.  These  conditions  are  enumerated  in  Table  3.  Each 
condition  was  repeated  five  times  by  each  of  12  pilots#  so  that 


Table  3.  EXPERIMENTAL  CONDITIONS 


CONDITION  NO. 

SHIP  MOTION 

VISOAt  DELAY 

MOTION  BASE 

G-SEAT 

1 

OPP 

OFF 

OPP 

OPF 

2 

m 

ON 

m 

3 

« 

m 

OPP 

ON 

4 

• 

ON 

OPF 

OPF 

5 

• 

•• 

ON 

N 

6 

« 

m 

OFF 

ON 

7 

ON 

OFF 

OPP 

OPF 

e 

• 

m 

ON 

m 

9 

« 

m 

OPP 

ON 

10 

« 

ON 

OPT 

OPF 

11 

« 

• 

ON 

N 

12 

e 

w 

OFF 

ON 

there  were  60  runs  per  condition.  The  means  and  standard 
deviations  for  position  errors,  pitch  and  roll  angles  and  control 
inputs  obtained  from  these  60  runs,  by  experimental  condition,  are 
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given  in  Table  4.  Also  shoifn  in  the  last  column  of  Table  4  Is  the 
variability  in  the  various  measures  that  is  attributable  to  pilot 
difference  alone  (expressed  as  a  standard  error  and  computed  from 
the  ANOVA  data  in  appendix  B  of  Ricard,  et  al  16] .  Un  for  tuna  telyr 
this  measure  cannot  be  separated  by  experimental  conditions  on  the 
basis  of  the  data  presently  available. 

The  reader  is  referred  to  Ricard,  et  al  [6]  for  a  detailed 
analysis  of  the  data  using  univariate  analysis  of  variance.  The 
discussion  here  will  be  very  brief.  Significant  effects  were  found 
_  on  _at_ least  some,  measures. for  all  the  experimental  variables, 
including  the  replicate  and  pilot  variables.  Indeed,  the  pilot 
factor  was  the  major  source  of  variance  among  the  experimental 
variables.  Motion  cueing  and  visual  delay  had  significant  effects 
on  the  error  measures  but  ship  movement  did  not.  Visual  delay 
tended  to  increase  the  values  of  all  system  variables  (error, 
states  and  controls).*  Platform  motion  had  a  significant  effect  on 
vehicle  roll  attitude  but  not  on  pitch.  Cyclic  pitch  increased 
with  platform  motion  while  cyclic  roll  decreased.  Most  pilots  used 
more  control  when  the  ship  motion  was  active.  In  addition  to  the 
main  effects,  there  were  a  number  of  significant  interactions, 
several  of  them  involving  the  pilot  factor.  For  example,  the 
effect  of  visual  delay  was  more  pronounced  when  there  was  no  ship 
motion. 

The  OCM  as  specified  above  was  used  to  predict  the  rms  values 
for  all  the  variables  of  interest  in  each  of  the  twelve  conditions. 
The  results  are  given  in  Table  5.  These  results  were  obtained  with 
s  fixed  yt  of  pilot  parameters— the  only  changes  made  in  the  model 
from  condition-to-condition  were  those  corresponding  to  changes  in 
the  simulation  (e.g.,  presence  or  absence  of  platform  motion, 
g-seat  or  ship  motion).  It  should  also  be  noted  that  when  used  in 
this  fashion,  the  OCM  is  intended  to  be  representative  of  the 
performance  expected  of  a  highly  trained,  highly  motivated  pilot 
who  has  been  allowed  to  reach  asymptotic  performance  on  each 
condition  before  data  are  taken. 

Comparison  of  Tables  4  and  5  shows  that  all  measures  predicted 
by  the  model  are  within  one  standard  error  of  the  means,  where  the 
standard  error  is  the  measure  of  pilot  variability  mentioned  above. 
This  Implies  that  the  model  is  as  good  a  predictor  of  a  pilot's 
performance  across  the  conditions  as  another  pilot  selected 
randomly  from  the  group.  Given  the  complexity  of  the  problem  and 
the  assumptions  made,  this  is  a  substantial  achievement. 


*  Sxcept  2or  two  pilots  whose  performance,  su rp rising ly,  improved 
with  delay. 
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The  model  predictions  are  also  within  one  standard  deviation 
of  the  mean  (where  the  variation  is  across  subjects  and 
replications)  for  virtually  all  measures  and  all  conditions.  The 
exceptions  to  this  are,  in  a  few  instances,  altitude  error,  cyclic 
pitch  and  pitch  angle.  These  exceptions  are  well  within  two 
standard  deviations  of  the  mean  and  most  are  only  marginally  more 
deviant  than  one  standard  deviation. 

Almost  all  model  predictions  are  somewhat  lower  than  the 
corresponding  mean  values  determined  experimentally.  This  suggests 
that  the  predictions  could  be  brought  in  even  closer  agreement  with 
the  measured  means  by  slight  increases  in  the  deJLay  or  noise 
parameters  of  the  model. 

If  we  examine  the  model  results  as  a  function  of  the  main 
experimental  variables,  additional  interesting  features  emerge. 

Effects  of  Motion  Cues.  Figure  1  shows  the  effect  of  motion 
cues  on  rail-tb-rail  error,  averaged  over  ship  motion  conditions, 
for  the  two  delay  conditions.  It  can  be  seen  that  the  g-seat  cues 
provide  some  improvement  in  performance  and  platform  motion  cues 
result  in  still  less  error.  Further,  the  effect  of  motion  cues 
does  not  appear  to  be  significantly  different  for  the  two  delay 
values;  i.e.,  there  does  not  appear  to  be  a  delay-motion 
interaction.  These  effects  of  motion  cues  exactly  parallel  the 
trends  contained  in  the  data  (Figure  3  of  Ricard  et  al  [6] ) . 
Reference  to  Table  5  indicates  that  the  remaining  error  terms  show 
the  same  trends. 

The  effect  of  motion  cues  on  the  attitude  variables  (fif  and  9) 
are  shown  in  Figure  2.  For  this  figure,  model  results  for  each 
motion  condition  were  averaged  across  the  delay  and  ship  motion 
variables.  The  g-cues  have  only  a  very  slight  effect  on  the 
attitude  variables.  Platform  motion  results  in  demonstrably  lower 
rms  attitude  values,  with  the  effect  for  roll  being  greater  than 
that  for  pitch.  Again,  these  effects  closely  parallel  those  in  the 
data  (See  Ricard,  et  al  [6]  Figure  15)  where  there  was  a 
significant  effect  of  motion  on  roll,  but  not  on  the  pitch  rms 
score. 

The  model  does  less  well  in  predicting  the  effects  of  motion 
cues  on  control  inputs,  particularly  pitch  cyclic.  As  can  be  seen 
from  Table  5,  rms  control  inputs  show  very  little  differences 
between  fixed  base  and  g-seat  condition,  with,  if  anything, 
somewhat  less  activity  with  the  g-seat  on.  However,  control  inputs 
are  significantly  reduced  in  the  moving  base  condition.  These 
trends  reproduce  those  for  the  roll  cyclic  data.  The  collective 
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Figure  1.  Effects  of  Motion  Cues  on  Rail-Rail  Hover 
Error 
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Figure  2.  Effects  of  Motion  Cues  on  Attitude  Errors 
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and  rudder  data  show  virtually  no  difference  between  the  fixed  base 
and  g-seat  conditions,  as  is  true  for  the  model;  however,  while 
there  appears  to  be  no  consistent  effect  of  platform  motion,  Ricard 
reports  that  most  pilots  use  significantly  more  collective  and 
rudder  for  this  condition,  contrary  to  the  predictions  of  the 
model.  Finally,  the  model's  trend  for  pitch  cyclic  does  not  agree 
at  all  with  the  observed  data.  In  the  experiment,  pitch  cyclic 
activity  Increases  when  motion  cues  are  added  and  is  greatest  for 
the  g-seat  condition. 

Visual  Delay.  The  OCM  predicts  that  all  measurements,  errors, 
states  and  controls  will  increase  with  the  addition  of  delay.  This 
pattern  is  also  evident  in  the  data.  However,  the  increases 
predicted  by  the  model  tend  to  underestimate  those  observed  in  the 
data;  i.e.,  the  OCM  is  doing  a  better  job  of  compensating  for  the 
delay  than  are  the  pilots.  Also,  while  the  model  accurately 
predicts  no  motion-delay  interaction.  Figure  3  shows  that  the  model 
does  not  predict  the  delay-ship  motion  interaction  that  was 
observed  (Ricard  et  al  [6],  Figure  12). 

Ship  Movement.  The  model  predicts  an  increase  in  errors, 
attitude  variables  and  control  inputs  when  ship  movement  is 
present.  The  model  results  are  not  surprising  from  an  analytic 
standpoint,  but  they  are  not  entirely  borne  out  by  the  data.  For 
example,  heave  error  increases  with  ship  movement  predicted  by  the 
model  are  much  greater  than  those  observed  empirically.  In 
addition,  the  model  predicts  increases  in  error  regardless  of  the 
delay  condition  whereas  the  data  show  decreased  errors  with  ship 
movement  for  the  longer  visual  delay.  Model  trends  are  confirmed 
for  the  attitude  variables,  with  ship  movement  increasing  rms  pitch 
and  roll  (for  most  pilots).  Although  the  mean  rms  values  of 
control  variables  do  not  exhibit  consistent  trends  (Table  4), 
Ricard  et  al  [6]  does  report  a  higiar  rudder  activity,  that  is 
significant,  with  ship  motion  and  that  other  control  activity 
measures  were  also  higher  for  most  pilots;  these  results  are  in 
Keeping  with  the  model's  predictions. 


CONCLUSION 

This  paper  has  described  the  results  of  a  brief  effort  to 
apply  the  OCM  to  analyze  data  obtained  in  an  experiment  aimed  at 
exploring  simulator  fidelity  factors.  The  experimental  task  was  to 
maintain  a  high  hover  position  relative  to  a  moving  ship.  Twelve 
skilled  pilots  performed  the  task  for  each  of  twelve  experimental 
conditions.  The  main  experimental  variables  were  motion  cue 
presentation,  visual  delay  and  ship  movement. 
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Ship  Movement  Condition 


Figure  3.  Effect  of  Ship  Movement  on  Predicted 
Rail- Rail  Hover  Error 


The  simulated  hover  task  was  specified  in  terms  needed  to 
apply  the  OCM.  The  vehicle  dynamics  were  of  substantial 
complexltyr  so  sin^lifying  assumptions  with  respect  to  simulator 
and  perceptual  characteristics  were  made  for  practical  reasons. 
The  parameters  of  the  model  relating  to  human  limitations  were 
selected  mostly  on  the  basis  of  previous  work,  though  cost 
functional  weightings  were  adjusted  to  give  a  reasonable  "match"  to 
the  base  experimental  condition. 


In  general/  the  model  predictions  agree  with  the  data  to  a 
substantial  degree,  with  most  of  the  differences  being  within  the 
range  of  experimental  variability.  There  appears  to  be  a  general 
trend  for  the  model  to  be  less  sensitive  to  configuration  changes 
than  the  mean  measures.  Unfortunately,  while  the  data  treatment 
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allows  us  to  determine  the  significance  of  a  difference  in 
j^er forntance  resulting  from  a  configuration  change^  it  does  not  tell 
us  the  magnitude  of  the  inter-subject  variability  in  this 
difference  (a  paired-difference  treatment  of  the  data  would  provide 
this  information).  Thus»  we  cannot  determine  whether  or  not  the 
differences  predicted  by  the  model  are  within  the  pilot-to-pilot 
variation.  Nonetheless,  there  are  two  assumptions  that  could 
readily  explain  a  lesser  degree  of  model  sensitivity  to 
configuration  change:  1)  that  performance  has  asymptoted  in  each 
condition  so  that  the  "pilot"  has  fully  adapted  to  the 
configuration;  and  2)  that  the  basic  pilot  limitations  (i.e.,  the 
OCM  model  parameters)  do  not  change  significantly  throughout  the 
experiment.  It  is  highly  suspect  that  these  assumptions  can  ever 
be  strictly  valid  in  a  factorial  experiment  of  this  size,  given 
practical  constraints.  On  the  other  hand,  for  this  very  reason, 
the  model  results  may  be  a  better  measure  of  the  differences  due  to 
configuration  changes  alone  than  are  the  data. 

The  excellent  agreement  between  model  and  data  for  the  fixed 
base,  no  additional  delay  case  suggests  that  the  information  the 
pilot  was  obtaining  from  the  external  scene  was  adequately 
accounted  for.  Although  we  did  not  show  the  results,  we  also 
obtained  model  results  under  the  assumption  of  no  visual 
thresholds;  these  results  failed  to  match  the  data.  Thus,  it  would 
appear  that  the  method  used  here  for  estimating  visual  thresholds 
from  analysis  of  the  external  scene,  proposed  by  Baron,  Lancraft 
and  Zacharias  [4]  is  reasonable. 

The  model  does  particularly  well  in  predicting  the  effects  of 
motion  cues  on  position  errors  and  attitude  angles.  This  suggests 
that  the  simple  informational  treatment  of  motion  cues  employed 
here  was  adequate  for  this  task.  Furthermore,  both  the  sensory 
thresholds  assumed  for  these  cues  and  the  assumption  of  no 
attention-sharing  within  the  motion-sensing  modalities  appear 
reasonable  in  light  of  the  model-data  agreement.  A  major  caveat  to 
these  conclusions  is  that  the  model  did  fail  to  predict  the  effect 
of  motion  on  pitch  cyclic  control,  a  fact  that  we  are  unable  to 
explain  based  on  our  limited  analysis.  It  should  also  be  noted 
that  one  is  unlikely  to  be  able  to  separate  definitively  the 
various  sources  of  pilot  observation  noise  (thresholds,  base 
noise/signal  ratio  and  attention  sharing  logic)  without  designing 
experiments  expressly  for  this  purpose  (see,  e.g.,  Levison  [101). 

The  main  effects  of  visual  delay  were  also  predicted  by  the 
model  as  was  the  lack  of  motion-delay  interaction.  The  model 
predicts  less  degradation  with  delay  than  is  observed  in  the  "mean" 
rms  performance  measures.  It  is  not  clear  that  the  lower 


sensitivity  of  the  OCM  to  increases  of  delay  is  attributable 
entirely  to  the  assumptions  mentioned  above.  There  is  the 
possibility  that  the  reduced  stability  margins  in  the  added  delay 
case  cause  the  pilots  to  adapt  their  strategies  in  response  to  an 
increased  tendency  for  Pilot  Induced  Oscillation  (PIO)  and  the 
model  does  not  account  for  this  change.  Further  analysis  would  be 
needed  to  resolve  this  question. 

The  model  was  less  successful  in  predicting  the  effects  of 
ship  movementr  in  particular  in  over-estimating  the  effects  on 
heave  error  and  in  missing  the  ship  roovement/delay  interaction.  On 
-the  basis  of  the  present  analysis,  we  cannot  tell  whether  this  is 
sinply  the  result  of  our  approximation  to  the  ship  movement  input 
or  it  is  due  to  some  other  inadequacy  of  the  model. 

In  sum,  these  results  demonstrate  a  significant  capability  for 
predicting  closed-loop  system  performance,  and  the  effects  on  it  of 
simulator  deficiencies,  for  even  highly  complex  tasks.  When  viewed 
in  light  of  other  recent  studies  of  a  similar  nature,  the  results 
clearly  point  to  the  conclusion  that  the  OCM  can  be  very  useful  for 
predicting  and  analyzing  engineering  requirements  for  simulators. 
This  includes  the  potential  for  design  and  evaluation  of  algorithms 
(such  as  washout  filters  or  delay  con^ensators)  to  ameliorate 
hardware  deficiencies. 

Several  areas  for  further  research  are  suggested  by  this 
effort.  A  major  source  of  variance  in  the  simulator  study  was  the 
pilot  factor;  there  were  significant  differences  between  pilots, 
both  quantitatively  and  qualitatively.  The  development  and 
application  of  the  OCM  has  stressed  modelling  the  performance  of  an 
"average"  well-trained,  we 11 -motivated  pilot.  This  is  highly 
appropriate  strategy  for  many  problems  of  system  design  and 
evaluation.  However,  there  are  obviously  individual  differences 
and  these,  too,  are  Inportant,  particularly  if  one  attempts  to 
address  training  and/or  "screening"  issues.  It  is  of  interest, 
therefore,  to  determine  the  extent  to  which  variations  of 
parameters  of  the  OCM  can  account  for  individual  differences  among 
skilled  pilots  or  among  pilots  in  various  stages  of  training. 

Although  the  model  did  quite  well  in  predicting  the  effects  of 
motion  cues,  there  are  still  several  issues  to  be  addressed.  One 
specific  issue  is  the  disparity  between  modelling  results  and  data 
in  the  control  activity  seen  in  the  mving  base  condition.  More 
generally,  we  need  a  basic  and  systematic  empirical  study  of 
g-seats  to  get  at  the  Imits  of  their  utility.  Interpreting  such 
studies  using  the  OCM,  especially  in  terms  of  perceptual 
limitations,  would  be  very  useful. 
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Finally#  with  respect  to  any  of  the  simulation  devices  or 
limits  examined  here#  it  is  important  to  investi9ate  their  effects 
on  skill  acquisition  (i.e.#  rate  of  learning)  and  on  transfer  of 
training,  as  well  as  on  performance.  It  may  well  be  that  a 
simulator  enhancement  does  not  improve  asyn^totic  performance  but 
does  reduce  training  time  or,  conversely,  that  it  in^roves 
simulator  performance  but  not  training.  We  believe  that  the  OCM 
could  provide  very  useful  insights  and  measurements  of  the  progress 
of  training,  but  it  requires  research  to  extend  it  so  that  it  will 
be  applicable  to  the  problem  of  skill  acquisition. 
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ABSTRACT 

■‘^In  this  study,  the  crew's;  behavior  and  performance  of  a  supervisory  con¬ 
trol  task  In  an  anti-aircraft  artillery  (AAA)  system  was  Investigated  from  an 
integrated-network-of-tasks  point  of  view.  The  supervisory  control  task  was 
characterized  by  a  sequence  of  subtasks  interconnected  and  performed  by  a  com¬ 
mander,  a  gunner,  and  a  range  operator.  A  subtask  flow  chart  was  developed  us¬ 
ing  the  structure  of  SAINT^  Distribution  of  various  times  to  complete  sub¬ 
tasks  were  constructed.  Procedural  data  were  categorized  into  different  groups 
according  to  mode  switching  patterns,  and  analyzed  with  performance  data  to 
find  strategies  In  the  commander's  decision-making  process.  Differences  In 
procedure  and  completion  times  due  to  target  maneuver,  visibility,  counter¬ 
measures,  and  C^.  Information  were  examined  and  quantified. 
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I.  INTRODUCTION 


The  tracking  and  firing  performance  of  an  individual  tracker  in  an  anti¬ 
aircraft  artillery  (AAA)  system  has  been  extensively  studied  in  the  past  [1]- 
[4].  Human  tracking  data  were  collected  to  develop  mathematical  models  for 
describing  human  tracking  behavior  in  different  system  operational  modes.  These 
data  and  models  were  also  used  to  evaluate  the  survivability  of  aircraft  In 
different  engagement  scenarios  [5].  Interest  In  the  study  of  the  performance 
of  crews  as  a  team  In  the  AAA  system  has  grown  recently.  Preliminary  work 
has  been  done  using  the  optxmal  control  approach  to  model  the  Interaction  and 
declslon-maklng  process  among  crew  members  [6]-[7].  Due  to  lack  of  empirical 
data  to  validate  the  model,  a  considerable  amount  of  additional  work  is  needed 
before  the  model  can  be  put  Into  practical  use.  A  different  approach  Is  pro¬ 
posed  here  to  analyze  the  performance  of  crews  In  terms  of  key  tasks  completed 
and  primary  operating  procedures  adopted.  The  method  of^^stems  Analysis  of 
Integrated  Networks  of  Ta8kT^( SAINT)  was  applied  to  model  crews  performance  as 
a  sequence  of  Interconnected^ subcasks. 

The  supervisory  control  task  was  broken  down  Into  a  series  of  subtasks 
undertaken  by  Individual  crew  members.  More  specifically,  these  subtasks 
Included  detection,  mode  decision,  acquisition,  mode  actualization,  tracking/ 
breaklock,  reacqulsltlon,  lead  angle  computer  (LAC)  solution,  and  firing. 

Task  completion  time  was  defined  as  the  time  required  to  complete  each  subcask. 
The  commander  was  allowed  to  select  one  of  three  operating  modes  interchange¬ 
ably  in  order  to  maximize  the  system  performance  In  terms  of  hit  score.  Ex¬ 
periments  were  designed  Co  collect  empirical  data  which  would  characterize 
Che  distribution  of  cask  completion  times  and  estimate  the  probability  of  se¬ 
lecting  a  system  mode.  Experiments  were  conducted  on  a  AAA  simulator  at  the 
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Air  Force  Aerospace  Medical  Research  Laboratory  in  WPAFB,  Ohio.  Thirty-two 
conditions  from  a  factorial  combination  of  trajectory,  visibility,  electro¬ 
countermeasure  (ECM),  and  c’  input  were  studied  to  determine  their  effects  on 
task  completion  time,  operating  procedure,  and  performance  score. 

Distributions  of  task  completion  time  were  constructed  from  the  empirical 
data.  Analysis  of  variance  was  performed  on  the  task  completion  time  to  deter¬ 
mine  the  effect  of  the  independent  variables.  The  crew's  operating  procedures 
were  categorized  into  different  groups  according  to  mode  switching  pattern  and 
peak  switching  time.  A  separate  analysis  of  variance  was  done  for  each  combin¬ 
ation  of  trajectory  and  visibility  to  test  the  effect  of  procedure  on  overall 
performance.  Significant  effects  of  procedures  were  found  in  certain  trajec¬ 
tories  coupled  with  good  visibility.  Probabilities  of  mode  switching  were 
estimated  from  the  procedural  data  based  oh  visibility,  target  maneuver,  and 
ECM  presence.  The  task  flowchart,  the  task  completion  times,  and  the  probabil¬ 
ity  estimates  obtained  here  will  be  used  to  develop  a  complete  SAINT  model  for 
the  simulation  of  a  AAA  supervisory  control  system  on  a  digital  computer. 

II.  EXPERIMENT 


Previous  studies  indicate  that  electronic  countermeasures,  complex  trajec¬ 
tories,  and  target  visibility  have  a  degrading  effect  on  tracking  and  firing 
accuracy.  On  the  other  hand,  the  effect  of  early  warning  information  from  the 
command,  communication  and  control  (C^)  network  on  crew  performance  is  of 
interest  from  an  integrated  engagement  point  of  view.  Thus  thirty-two  experi¬ 
mental  conditions  were  designed  from  a  factorial  combination  of  two  levels  of 
ECM,  visibility,  input,  and  four  levels  of  trajectory  (see  Table  1). 

Electronic  countermeasures  were  either  1)  present  in  the  form  of  both  a 
noise  strobe  and  a  false  target  or,  2)  not  present  at  all.  Visibility  of  10.8 
KM  and  2.0  Km  were  considered.  input  was  presented  in  the  form  of  target 
position  on  the  commander's  console  display,  either  available  or  absent.  In¬ 
put  trajectories  Included  two  weapon  delivery  trajectories  and  two  flyby  tra¬ 
jectories.  Ten  replications  of  each  of  the  32  conditions  were  obtained  for  each 
team.  Five  teams  of  subjects  participated  in  the  experiment  and  each  team  con¬ 
sisted  of  a  commander,  a  gunner,  and  a  range  operator.  This  constituted  a  total 
sample  size  of  50  for  each  condition.  The  presentation  order  of  the  32  engage¬ 
ment  scenarios  were  randomized  within  each  replication. 


The  functional  roles  of  each  crew  member  were  defined  and  structured  so 
that  subjects  could  be  trained.  The  subtasks  of  the  commander  included  1) 
assessing  the  situation,  2)  deciding  and  requesting  the  desired  system  mode, 
and  3)  monitoring  the  situation  (including  gunner  performance,  capability  limit, 
and  change  of  target  status).  The  gunner's  subtaska  were  divided  into  1) 
searching  for  the  target  using  either  an  optical  device  or  a  radar  screen,  2) 
acquiring  the  target,  3)  actualizing  the  sys^-em  mode  selected  by  the  commander, 
4)  cracking  the  target,  5)  reacquiring  the  i  t,  and  6)  firing  the  guns. 

The  subtasks  of  the  range  operat  r  were  1)  ht  ig  detect  the  target,  2) 
acqulrlng/reacqulrlng  the  target,  and  3)  tracking  the  target's  range. 

There  were  three  system  modes  of  operation  available  for  the  commander's 
choice.  These  modes  were  designated  as  Mode  A  (automatic  Cracking  mode), 
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Mode  S  (sanlautonatic  tracking  mode)  and  Mode  M  (manual  mode).  The  system 
was  considered  to  be  in  Mode  0  If  none  of  the  above  modes  had  been  actualized 
by  the  gunner.  The  general  configuration  of  the  manned  AAA  system  is  shown 
in  Figure  1. 


Figure  1.  General  Configuration  of  an  AAA  System 

A  command  originated  with  the  commander  and  was  carried  out  by  the  gunner  and 
the  range  operator.  On  a  typical  trial,  once  the  target  was  detected,  the 
commander  would  choose  a  system  mode  to  engage  the  target.  A  verbal  command 
was  then  issued  to  the  gunner  and  the  range  operator  who  would  carry  out  that 
command.  In  the  event  that  system  capabilities  were  degraded  due  to  ECM,  vis¬ 
ibility,  or  target  maneuver,  this  Information  was  fed  back  to  the  commander 
who  would  make  a  new  decision  between  keeping  the  system  In  the  same  operating 
mode  or  changing  to  another  mode.  Onset  and  completion  time  of  Individual  sub 
task  were  measured  in  the  experiment.  An  overall  performance  measure,  "per¬ 
centage  of  hits",  was  developed  and  It  was  the  ratio  of  the  number  of  hits 
placed  on  the  target  Co  the  number  of  rounds  fired.  This  single  measure  of 
performance,  in  contrast  Co  measures  used  in  previous  experiments,  such  as 
tracking  error,  tracer  error,  and  miss  distance,  reflected  the  performance 
of  the  entire  crew  instead  of  Individual  crew  members  and  measured  performance 
for  all  modes  of  operation.  In  other  words,  the  commander's  decision  as  well 
as  the  gunner's  and  the  range  operator's  tracking  and  firing  all  contributed 
Co  this  single  performance  measure.  This  score  was  presented  to  the  crew  at 
the  end  of  each  trial  as  a  feedback  metric. 
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HI.  TASK  ANALYSIS  USING  SAINT 

In  order  to  apply  the  SAINT  technique  [8]  to  modeling  and  simulation  of 
a  AAA  supervisory  control  system,  crew  activities  were  divided  Into  a  sequence 
of  interconnected  tasks.  Each  task  was  represented  and  specified  In  terms  of 
the  symbolism  and  terminology  of  SAINT.  The  standard  symbol  of  a  task  Is  de¬ 
picted  In  Figure  2. 


A  cask  Is  characterized  by  Its  Input  (precedence)  relation  with  other  tasks, 
description  of  the  task,  and  Its  output  relation  with  other  tasks.  Tasks 
are  represented  by  nodes  and  connected  by  branches.  The  combination  of 
branches  and  nodes  forms  a  network  model  which  serves  as  an  abstract  repre¬ 
sentation  of  a  system.  Once  the  network  model  Is  constructed  from  the  system 
or  from  Che  task  Co  be  analyzed  (In  this  case  the  AAA  supervisory  control 
system)  the  SAINT  computer  program  can  be  used  to  simulate  the  task  flow 
within  the  system. 

The  basic  tasks  involved  in  a  supervisory  control  system  were  obtained  by 
dividing  the  engageme^*-  scenario  Into  separate  phases.  Each  phase  was  repre* 
sented  by  a  task  ur  en  by  specified  crew  member(8)  or  other  resources 

such  as  the  lead-ang...b-computer .  These  tasks  were  detection  of  target,  com¬ 
manding  the  system  mode,  mode  actualization,  tracking,  obtaining  the  lead  angle 
solution,  commanding  the  onset  of  firing,  firing,  and  maintaining  accuracy  of 
firing.  Based  on  this  configuration,  a  SAINT  model  for  a  AAA  supervisory  con¬ 
trol  system  was  developed  and  Is  presented  In  Figure  3.  The  model  presented  here 
is  far  from  complete,  yet  It  provides  a  structured  representation  of  the  under¬ 
lying  system  and  tasks.  It  also  provides  a  basis  for  defining  major  system 
variables  to  be  measured  from  Che  current  experiment  and  for  performing  prelim¬ 
inary  task  analyses.  We  will  briefly  describe  each  task  and  other  relevant 
components  of  the  model,  such  as  state  variables,  user  functions,  and  so  forth. 

Detection  of  Target  was  designated  as  Task  1  with  a  label  DET.  The  com¬ 
pletion  time  of  this  task  could  be  determined  empirically,  as  was  done  here, 
or  could  be  drawn  from  one  of  the  eleven  distribution  functions  available  in 
SAINT:  constant,  normal,  uniform.  Erlang,  lognormal,  Poisson,  beta,  gamma, 
beta  fitted  to  three  estimates,  triangular,  and  Weibull  [8].  A  moderator  fun¬ 
ction,  MODF  1,  which  Is  defined  by  the  user,  could  be  used  to  indicate  values 
of  the  parameters  of  the  desired  distribution  function  based  either  on  experi¬ 
mental  data  or  some  prior  knowledge.  Resource,  RESR,  designated  the  operacor(8) 
or  the  machine  performing  the  task.  In  this  case,  only  one  crew  member  was 
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required  to  detect  the  target.  The  commander,  the  gunner,  and  the  range  oper¬ 
ator  were  designated  as  Resource  1,  2,  and  3,  respectively.  OR  Indicated 
that  any  one  of  the  crew  members  could  have  performed  the  task.  On  the  Input 
side  of  the  task  node,  the  wavy  arrow  Indicated  that  the  first  release  of  the 
task  did  not  require  the  completion  of  a  proceeding  task.  The  00  sign  meant 
the  detection  task  would  only  be  performed  once  and  no  subsequent  release  of 
the  task  was  expected. 

Commanding  the  System  Mode,  performed  by  the  commander,  was  designated 
as  Task  2  with  a  label  MODES .  Since  the  commander  could  select  one  of  three 
available  system  modes,  the  output  of  this  task  had  three  branches.  Each 
branch  leads  to  a  different  mode  actualization  task  with  a  branching  probabil¬ 
ity  lb  the  next  section,  we  will  generate  preliminary  estimate  of  these 
probabilities  based  on  empirical  data  collected~ln~ this' experiment.  A  monitor 
function  ENT  FIRE,  denoted  by  [Q  — was  reserved  to  be  used  as  an  indicator 
that  the  target  was  within  the  effective  firing  range  and  a  manual  mode  should 
be  adopted  to  engage  the  target  immediately.  Attribute  assignment.  ATAS,  was 
used  to  assign  value  of  various  attributes:  information  attributes  (lA),  sys¬ 
tem  attributes  (SA) ,  or  resource  attributes  (RA).  For  Instance,  the  ECM  con¬ 
dition  was  represented  by  lA  (1),  with  a  value  1  meaning  the  presence  of  ECM 
and  a  value  0  meaning  no  ECM.  In  RESR  row,  AMD  indicated  that  all  the  re¬ 
sources  listed,  In  this  case  only  the  commander,  were  required  to  perform  the 
task. 

Mode  Actualization,  perfomed  by  the  gunner,  was  designated  as  Task  3 
(LOCKON  A),  S  (LOCKON  S)  or  8  (Mode  M)  corresponding  to  the  three  different 
modes  which  could  have  been  commanded.  In  Modes  A  and  S,  the  task  Involved 
making  the  proper  mode  switch  throw,  acquiring  the  target,  and  lockon  to  the 
target.  In  Mode  M,  the  task  only  required  making  the  proper  mode  switch  throw. 
A  task  priority,  PRTY,  was  developed  to  provide  the  scheduling  of  a  task  in 
case  of  a  resource  conflict.  Since  both  Tasks  5  (LOCKON  S)  and  6  (TRACK)  re¬ 
quired  Resource  2  (the  Gunner)  to  perform  them  and  Task  5  should  have  been 
completed  first  If  both  tasks  were  waiting  to  be  performed,  a  higher  priority 
(7.0)  was  given  to  Task  5. 

Tracking,  performed  by  the  gunner  and/or  the  autotrack  system,  was  desig¬ 
nated  as  Task  4  or  5  corresponding  to  Mode  A  or  S.  In  Mode  A,  the  autotrack 
system  would  Crack  the  target's  range  and  angular  position  automatically. 

If  the  Cracking  error,  ERR,  was  within  certain  system  tolerance,  El,  the  sys¬ 
tem  would  continue  to  track  and  release  the  next  task  (lead  angle  solution) . 

If  the  tracking  error  exceeded  El,  the  system  would  breaklock  and  Task  3,  the 
mode  actualization  Cask,  would  be  released  again.  If  the  tracking  error  were 
large  enough  to  cause  a  complete  loss  of  target  (exceeded  system  criterion  E2) 
the  commander  would  be  informed  so  that  he  could  consider  a  possible  system 
mode  change.  A  condltlonal-take-all  branching,  which  is  a  deterministic 
branching  mechanism,  was  used  to  perform  Che  required  error  testing  and  branch¬ 
ing.  Should  a  probability  branching  be  desired,  probabilities  of  releasing 
each  subsequent  task  need  Co  be  assigned  a  priori  or  estimated  from  the  empir¬ 
ical  data.  In  Mode  S,  the  only  difference  from  Mode  A  was  that  the  gunner 
would  crack  the  angular  position  of  Che  target. 

Obtaining  the  Lead  Angle  Solution,  performed  by  the  lead  angle  computer 
or  Che  gunner,  was  designated  as  Task  7  for  Modes  A  and  S  or  Task  9  for  Mode  M. 
In  the  former  case,  the  lead  angle  computer  would  cake  a  fixed  time  to  calcu¬ 
late  a  lead  angle  and  direct  the  barrel  pointing  accordingly.  An  indicator 
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light  %fould  come  on  when  a  solution  was  reached.  In  the  latter  case,  the 
gunner  would  calculate  a  lead  angle  and  direct  Che  barrel  pointing  based  on 
his  estimation  of  target  velocity  and  the  miss  distance  of  previous  rounds 
fired. 

Cotanandlng  the  Onset  of  Firing,  performed  by  the  commander,  was  repre¬ 
sented  by  Task  10.  A  condltlonal-take-f Irst  branching  was  used  here  to  select 
Che  first  branch  which  satisfied  the  accompanying  condition.  For  Instance, 

IA(4)  denoted  the  solution  status  of  lead  angle  computer.  When  IA(4)  equaled 
1,  it  meant  a  solution  had  been  achieved  and  subsequently,  a  firing  command 
would  be  Issued  which  would  release  Task  11  and  result  In  actual  firing.  When 
lA  (4)  equaled  0,  It  meant  a  solution  had  not  been  achieved  and  no  firing  com¬ 
mand,  would  be  issued.  Instead,,  either  Task  4,  6,  or  9  vrould  be  released. 

Firing,  performed  by  the  gunner,  was  denoted  by  Task  11.  A  high  priority 
(10.0)  was  given  to  this  task  compared  with  tasks  of  mode  actualization  and 
tracking.  The  attributes  of  Che  Initial  speed  and  firing  angle  were  assigned  at 
the  completion  of  this  cask.  These  attributes  were  used  as  parameters  in  the 
following  task  which  Involved  the  computation  of  Intercept  and  miss  distance 
of  rounds  fired. 

Maintaining  Accuracy  of  Firing,  performed  by  the  flyout  computer,  was 
designated  as  Task  12.  The  time  required  to  complete  this  task  was  a  variable 
depending  upon  the  target  range  and  firing  angle.  A  moderator  function  was 
therefore  reserved  for  modification  of  the  completion  time  on  the  basis  of  the 
assigned  attribute  values  and  state  variable  values.  System  variables  which 
changed  value  continuously  over  time  were  referred  as  state  variables.  Dynamic 
equations  (algebraic  or  differential  equation)  which  governed  time-dependent 
behavior  of  state  variables  were  used  In  the  subroutine  STATE  to  update  the 
value  of  these  variables  at  each  time  step.  Variables  of  Interest  Included 
the  simulation  time  SS(1),  the  range,  elevation  and  azimuth  angle  of  the  tar¬ 
get,  SS(2},  SS(3)  and  SS(4);  and  the  elevation  and  azimuth  tracking  error, 

SS(S)  and  SS(6).  One  example  of  the  STATE  subroutine  would  be  to  apply  existing 
human  operator  models  [3]  [4]  to  generate  cracking  error  under  various  opera¬ 
tional  conditions.  For  chose  cases  In  which  dynamic  equations  were  not  avail¬ 
able  for  a  specific  variable,  a  user-generated  subroutine  UINFUT  could  be  used 
to  read  In  the  values  of  this  variable  directly  from  input  and  store  them  in 
an  array  for  later  use. 

Additional  user-generated  subroutines  USERF  were  defined  to  provide  com¬ 
putation  of  ocher  system  functions  and  data  communication  between  Casks. 

Examples  are  the  computation  of  lead  angle  in  Mode  A,  S,  and  M,  the  Intercept 
time  and  the  miss  distance  or  hit  score  whenever  a  round  was  fired.  The  simu¬ 
lation  stopped  when  the  simulation  time  first  exceeded  a  designed  time  TE, 
specified  in  input  data.  The  CD  monitor  function  END  5IMU  and  Task  13  were 
designed  to  end  the  simulation. 

IV.  RESULTS  AND  DISCUSSION 

Analysis  of  Task  Completion  Time 

Task  completion  time  for  detection  of  target  (T^) ,  command  system  mode 
(Tj^),  and  acquisition  (T^)*  were  collected  from  the  experiment. 

*  Acquisition  task  begins  at  the  completion  of  detection  and  ends  at  the  com¬ 
pletion  of  mode  actualization. 


Examination  of  histograms  of  these  times  Indicated  that  the  data  were  skewed 
to  the  right  (See  Figure  4) .  These  sample  distributions  were  compared  to  both 
the  expoentlal  and  lognormal  distributions.  Detection  time,  was  found  to 
be  approximately  lognormally  distributed;  time  to  command  the  ‘^system,  T^, 
was  approximately  exponential;  neither  distribution  yielded  a  satisfactory 
fit  to  time  of  acquisition,  T^.  Further  work  will  be  done  to  find  an  approp¬ 
riate  description  of  these  sample  distributions,  so  that  these  times  can  be 
used  in  future  SAINT  simulations.  These  data  are  stnsmarlzed  In  Table  1,  which 
shows  the  means  and  standard  deviations  of  the  log-transformed  values. 

40.00 ..  EXP:  SCIII 

CONO  1  (WEAPON  1,  EW.  10.8  VISIB.) 


Figure  4.  Frequency  Distribution  of  Tjj,  Tj^,  and  T^ 

Separate  analyses  of  variances  (ANOVA)  were  performed  on  the  task  com¬ 
pletion  time  to  determine  the  effect  of  independent  input  variables.  Prior  to 
these  analyses,  the  data  were  transformed  using  the  logarithmic  transformation 
so  that  the  distributions  were  approximately  symmetric.  Due  to  a  large  num¬ 
ber  of  empty  cells  in  the  conditions  using  the  WEAPON  2  trajectory  under  the 
2.0  km  visibility  the  data  set  was  divided  into  two  parts. 

One  consisted  of  all  conditions  using  the  trajectories  WEAPON  1,  FLYBY  1 
and  FLYBY  2,  the  other  consisted  of  the  10.8  km  visibility  conditions  of 
trajectory  WEAPON  2.  The  first  set  of  data  was  analyzed  by3x2x2x2x5 
mixed  model  ANOVA  with  main  factors  trajectory,  visibility,  E(^,  presence 
or  absence  and  team  (random).  The  second  set  of  data  was  analyzed  by  2  x  2  x  5 
mixed  model  with  main  factors  ECM,  and  team  (random). 


For  the  three  trajectory  model  of  target  detection  time,  ECM  had  a 
significant  main  effect,  and  the  Interactions  of  ECM  with  visibility,  with 
visibility,  ECM  with  C^,  and  visibility  with  ECM  and  C^  were  all  significant. 
The  interpretation  of  these  results  is  as  follows:  for  relatively  easy  condl*- 
tlons  (high  visibility  and  all  of  these  three  easy  trajectories),  the  presence 
of  ECM  actually  shortened  detection  time  somewhat;  C^  had  no  effect.  For  low 
visibility,  Tp  Increased  if  both  (1)  ECM  was  present  and  (2)  C"*  information 
was  not  available.  For  the  :pdel  with  only  the  WEAPON  2  trajectory  and  high 
visibility,  the  absence  of  C^  Information  significantly  Increased  target  detec¬ 
tion  time.  From  what  data  were  available  from  this  trajectory  In  the  low  visi¬ 
bility  condition,  it  appears  that  T  was  much  higher  for  this  group  of  condi¬ 
tions  than  any  other  conditions,  ana  that  neither  ECM  nor  C"^  altered  time  of 
detection. 


Visibility  had  a  significant  effect  on  mode  decision  time,  for  the 

three-trajectory  model.  High  visibility  increased  T^,  presumably  because 
more  time  was  available  to  make  the  decision.  Mode  aeclslon  times  were  higher 
for  the  WEAPON  2  trajectory  than  for  any  of  the  other  three,  and  high  visibility 
decreased  T^,  rather  than  increasing  it.  This  reversal  may  be  due  to  Increased 
task  difficulty  for  this  trajectory  in  the  low  visibility  condition. 

The  interaction  of  visibility  and  C^  had  a  significant  effect  on  acquisition 
time,  T. ,  in  tl 
C^  information 
model  showed  m 

conditions.  Data  from  the  low  visibility  conditions  were  too  scanty  to  draw  any 
conclusions  from  them. 


!  three- trajectory  model.  This  was  due  to  a  decrease  in  T^  when 
'as  available  in  low  visibility  conditions.  The  one  trajectory 
significant  differences  due  to  ECM  or  for  the  high  visibility 


Analysis  of  the  Effects  of  Procedure 


In  this  experiment,  the  percentage  of  hits  was  used  to  measure  the  effec¬ 
tiveness  of  the  crew's  procedure.  The  procedures  under  analysis  were  not  pre¬ 
determined  before  the  experiment;  instead,  they  were  identified  by  examination 
of  the  actual  behavior  of  the  crews  during  the  experiment.  This  allowed  the 
crew  to  exercise  different  procedures  on  their  own  and  arrive  a  set  of  pre¬ 
ferred  procedures.  The  following  is  a  list  of  procedures  which  were  compared: 

1)  Mode  A  maintained  during  entire  trial 

2)  Mode  M  maintained  during  entire  trial 

3)  Switch  from  Mode  A  to  Mode  S  early  in  the  trial 

4}  Switch  from  Mode  A  to  Mode  S  late  in  the  trial 

3)  Switch  from  Mode  A  to  Mode  M  early  in  the  trial 

6)  Switch  from  Mode  A  to  Mode  M  late  in  the  trial 

7)  Switch  from  Mode  A  to  Mode  S,  then  to  Mode  M 

Analysis  of  variance  was  applied  to  compare  percentage  of  hits  among 
procedures  such  that  the  trajectory  and  visibility  factors  were  constant  and 
trials  from  different  teams  were  used  interchangeably.  This  resulted  in  eight 
ANOVA  designs,  one  for  each  combination  of  trajectory  and  visibility,  which 
were  unbalanced  but  had  no  empty  cells.  Only  two  of  the  eight  ANOVA 's  showed 
a  significant  difference  in  performance  due  to  procedure  f*-  0.05).  Specifi¬ 
cally,  in  the  FLYBY  1  trajectory  with  visibility  10.8  km  the  best  procedure 
for  maximizing  percentage  of  hits  was  Procedure  3,  followed  by  Procedure  1, 
then  Procedure  4.  This  is  illustrated  In  Figure  5  in  which  three  procedures 
(time  history  of  commander's  mode  selection)  were  ranked  from  top  to  bottom 
according  to  their  performance  score. 
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Estimate  of  Mode  Selection  Probability 


The  probability  that  the  commander  would  select  a  certain  system  mode 
could  be  defined  across  time  or  In  more  detail  as  a  function  of  time.  For 
this  application.  It  was  Impractical  to  estimate  the  probability  at  each  tine 
step.  The  estimates  of  mode  selection  probability  obtained  here  were  event- 
based  Instead.  Empirical  data  Indicated  that  Input  had  no  significant  effect 
In  the  determination  of  procedure.  Therefore,  target  visibility,  target  maneu¬ 
vering  and  ECM  presence  were  chosen  as  the  events  to  predict  the  values  of 
mode  selection  probability.  The  fact  that  any  one  of  the  three  events  were 
tine-dependent  made  the  mode  selection  probability  an  Implicit  function  of 
time. 

An  Index  function  I  (t)  was  defined  for  the  target  visibility  event. 

I^(t)  took  a  value  "0"  if  the  target  was  not  visible  at  time  t;  otherwise.  It 
took  a  value  "1".  Similarly,  index  functions  and  l^(b)  were  defined 

for  the  target  maneuver  event  and  the  electro-countermeasure  event, 
equaled  1  if  the  target  was  taking  a  maneuvering  course;  otherwise,  it  equaled 
0.  ^(t)  equaled  1  If  the  electro-countermeasure  was  present,  otherwise,  It 

equaled  0.  The  mode  selection  probability  ^  ^  )  vas  expressed  In 

terms  of  the  Index  functions.  To  estimate  the  mode  st&leStlon  probability  Pj^ 
from  empirical  data,  the  percent  of  sample  runs  using  each  procedure  were 
tabulated  In  Table  2.  Notice  that  we  combined  Procedures  3  and  4  (defined 
In  the  analysis  of  procedure  section)  Into  one  procedure  characterized  by  a 
Mode  A  to  Mode  S  switch  because  the  switching  time  per  se  was  not  critical  here. 
Similarly,  Procedures  5  and  6  were  combined  Into  one.  The  column  "other" 
consisted  mostly  of  unsuccessful  attempts  to  detect  or  engage  the  target. 

Prom  Table  2,  data  were  grouped  according  to  the  events:  visibility, 
maneuver  and  ECM,  as  listed  in  Table  3. 


Event 

Index 

Condition 

(0,*,*) 

5-8,  21-24,  29-32 

(1,1,*) 

1-8 

(1,0,1) 

19,  20 

(1,0,0) 

17-18,  21-22 

Table  3.  Condition  Grouping  for  Events 
Both  0  and  1  Included 


Since  the  "other"  procedure  column  was  not  of  Interest  In  figuring  the  prob¬ 
ability,  It  was  disregarded.  Percent  use  of  procedure  was  recomputed  for 
each  condition.  Estimated  mode  selection  probabilities  were  obtained  by 
computing  the  average  percent  selecting  Mode  A,  S  and  M  in  each  group  of 
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conditions  corresponding  to  particular  events.  It  should  be  pointed  out  chat 
time-dependency  of  events  were  considered  in  the  grouping  of  conditions  and 
in  estimating  Che  mode  selection  probability.  Also,  conditions  were  grouped 
so  that  the  probabilities  of  mode  selection  within  each  group  shoved  similar 
patterns  and  were  reasonably  consistent  with  each  other.  For  example,  the 
event  of  Che  target  not  being  visible  was  determined  by  the  visibility  (which 
was  constant  in  time)  in  this  experiment  and  the  target  range  (which  was  a 
function  of  time).  By  examining  the  percent  use  of  procedure  across  all  the 
procedures  in  Cond.  5-8,  21-2A,  29-32,  a  consistent  estimate  of  probability 
of  selection  of  Mode  A  for  the  event  (0,  *)  was  obtained.  It  is  interest¬ 

ing  to  note  that  mode  switching  from  Mode  A  to  S  or  A  to  M  occurred  after  the 
target  became  visible.  Hence  the  probability  of  selecting  Mode  A  with  the 
target  not  visible  equaled  1.0,  disregarding  the  "other"  column.  Estimated 
probabilities  are  presented  in  Table  4. 


Event 

Index 

Not  Visible 

Visible  1  1 

Maneuvering 

Not  Maneuver Ine  1 

EstT'^.^^ 

Proba.^"^ 

(0.*.*) 

(1.1.*) 

ECH 

(1.0,1) 

No  ECM 
(1.0.0) 

1.0 

0.14 

0.53 

0.65 

^2 

0. 

0.38 

0.47 

0.35 

"3 

0. 

0.48 

0. 

0. 

Table  4.  Estimated  Probability  of  Mode  Selection 

Both  0  and  1  included 

Since  Che  commander  does  not  change  mode  constantly,  it  is  expected  that 
additional  triggering  mechanisms  are  needed  in  the  mode  selection  task  (MODES) 
Co  trigger  the  release  of  the  task.  The  probability  estimates  obtained  here 
are  useful  once  the  Cask  Is  released  and  completed. 

V.  SUMMARY  REMARKS 


Crew  performance  in  a  AAA  supervisory  control  task  was  studied  using  the 
SAINT  method.  The  task  was  divided  into  a  sequence  of  interconnected  sub¬ 
tasks.  A  flowchart  of  subtasks  was  developed  in  which  each  subtask  was  char¬ 
acterized  by  a  Cask  completion  time  and  a  set  of  branching  probabilities.  An 
experiment  was  designed  to  collect  crew  procedural  data  from  which  distribu¬ 
tions  of  task  completion  time  were  constructed  and  summary  statistics  were 
obtained.  Estimated  probability  of  mode  switching  in  one  subtask  was  calcu¬ 
lated  from  the  procedural  data  as  a  function  of  target  visibility,  target 
maneuver,  and  ECM  presence. 

Separate  analyses  of  variance  were  performed  on  the  task  completion  time 
data  and  the  procedural  data.  Significant  effects  of  the  Independent  vari¬ 
ables,  input,  and  visibility,  on  task  completion  times  were  found.  Signifi¬ 
cant  effects  of  procedures,  in  terms  of  mode  switching  pattern,  on  perfor¬ 
mance  score  were  also  found  in  certain  trajectories  coupled  with  good  visi¬ 
bility.  It  was  also  noticed  that  in  some  cases  the  timing  of  mode  switch 
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had  critical  impact  on  the  final  performance  score.  It  is  anticipated  that 
the  data  obtained  in  this  study  will  be  used  to  further  refine  a  AAA  super¬ 
visory  control  simulation  model  using  SAINT.  Existing  tracker  models  and 
attrition  models  could  also  be  Incorporated  into  the  simulation  model  to  pro¬ 
vide  an  overall  crew-ln-the-loop  simulation. 
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TABLE  2,  PERCENT  USE  OF  PROCEDURE 
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HOMAN  RESPONSE  MODELING  AND  FIELD  TEST  VALIDATION 
OF  AN  AIR  DEFENSE  GUN  SYSTEM  SIMDLATION 


Tk^K. /Tin,  Ki?Sah«rat  V*  D«a  and  AlSfatob 
G^ERAL  DYNAMICS,  POMONA  DIVISION 


aoiiifix 

/  _  -  -  -  -  ■  ■ 

■atheBatloal  aodel  of  a  gunnar  vaa  davalopad  to  rapraaant  tba 
raaponsa  of  a  wall-tralnad  and  aotlvated  operator  of  a  dual  axla 
ooapenaatory  tracking  task  of  a  blgb  perforaanoe  air  defense  gun  systea. 
The  aodel  Is  based  on  tbe  quaslollnear  transfer  function  approaob.  Tbe 
paraaeters  used  in  tbe  aodel  were  derived  froa  tbe  tracking  experlaents  of 
16  gunners  vbo  operated  a  real  tlae  aan-ln»loop  slaulatlon  against  a 
variety  of  targets. 


This  buaan  aatb  aodel  was  then  Integrated  Into  a  3>D  Fortran  optic 
traok  and  fire  slaulatlon.  It  was  validated  by  ooaparng  the  critical 
paraaeters  of  the  slaulatlon  results  with  field  test  results.  Tbe 
ooaparlson  were  aade  by  both  Monte  Carlo  aetbods  as  well  as  by  single 
runs.  This  slaulatlon  Is  the  aatheaatloal  counterpart  of  tbe  hardw^e,the 
software  and  tbe  operator  of  an  advanced  air  defense  gun  systea. 


IMiaQimCTIQH 

During  tbe  course  of  developing  an  advanced  air  defense  gun  systea,  a 
Fortran  ooaputer  slaulatlon  prograa  was  written  In  order  to  facilitate  tbe 
systea  design,  hardware  and  software  integration,  and  perforaanoe 
prediction.  Tbe  optic  annual  control  aode  required  a  aatheaatloal  aodel 
of  a  buaan  operator's  response  .  Teobnlques  of  aodellng  suob  an  operator 
as  a  control  eleaent  bas  long  been  established  by  pioneering  work  suob  as 
MoRuer's  cross-over  aodelCl],  Hess's  dual  loop  sodel[2]  and  Klelnaan's 
optlaal  control  nodelC3]>  However,  we  were  aost  concerned  with  tbe 
application  of  an  buaan  aodel  In  a  distal  coaputer  slaulatlon  in  order  to 
study  tbe  systea  perforaanoe  rather  tban  tbe  aodel  Itself.  The  transfer 
function  approach  was  chosen  because  of  Its  slapllolty  and  acre 
laportantly  because  tbe  aodelllng  could  proceed  In  parallel  wltb  systea 
design  and  thus  also  served  as  a  design  tool. 


REAL  TIME  MAM-IM-LQQP  SIMDLATIOM 

In  order  to  provide  the  aeans  of  paraaeter  quantification  of  tbe 
buaan  aatb  aodel, we  used  a  real  tlae  aan-ln-loop  slaulatlon.  Tbe 
slaulatlon  hardware  consists  of  a  PDF  11/34  ooaputer  systea,  a  Megatek 
graphics  display,  and  a  control  handle  set  which  enables  tbe  operator  to 
Interface  wltb  the  ooaputer.  A  silhouette  of  tbe  target  appears  on  tbe 
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8or6en  aooordlng  to  a  pre^daflned  trajeotory.  The  operator  oloaea  the 
optlo  traok  loop  when  he  atteapta  to  keep  the  reticle  of  the  optio  eight 
on  the  target  by  ualng  the  thumb  foroe  tranaduoer  on  the  handle.  The 
whole  almulation  runa  In  real  time.  Time  hlatorlea  of  the  orltloal 
varlablea  were  recorded  for  off  line  analyala.  Pig.  1  ahowa  a  pictorial 
deaorlption  of  the  aimulatlon. 


WII/X  JTUtll 


Pig.1  REAL  TIME  MAN-IN-LOOP  SIMULATION 


The  tranafer  function  which  repreaenta  the  determlniatic  part  of  an 
operator’a  reaponae  in  a  oonpenaatory  tracking  taak  la  taken  from 
McRuerCl].  the  tranafer  funotlo/i  of  the  determlniatic  part  ia  given  below 
and  a  block  diagram  of  the  model  la  ahown  in  Pig.  2. 
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Flg.2  HUNAN  MATH  MODEL 


The  remnant  la  modelled  by  three  nolaea  whloh  rapreaent  the 
unoertalnoy  of  the  operator 'a  eatlmatea  of  vlaual  Inputa  aa  well  aa 
control  outputa  plua  a  third  independent  noiae  aouroe.  Tba  obaervatlon 
error  la  modelled  by  a  Qauaalan  noiae  with  varlanoe  propotional  to  the 
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error  signal.  The  error  signal  represents  the  difference  between  the 
target  line  of  sight  and  optlo  sight  boreslght  center  line.  The 
neuroBUsoular  noise  Is  proportional  to  the  thunb  force  output.  The  third 
noise  is  Independent  of  outside  stlnulus.  The  need  of  this  tern  was  due 
to  the  real  tine  nan-in-loop  tracking  ezperlnents  of  very  low  speed  or 
near  stationary  targets.  The  nunerloal  values  of  the  nodel  Is  listed  In 
Table  1. 


Table  1 


(fron  .072  to  .162  seo) 
(fron  292  to  382  volt/seo) 
(fron  18.0  to  22.0  seo) 
(fron  2.0  to  5.0  seo) 


’n  :  .1  seo 

Varl:  (fron  .00067  to  .002) 
Var2:  (fron  .004  to  .012) 
var3:  (fron  .004  to  .012) 


TARGET  UK 


OPTICAL 

1 

SIOIT 

S 

SERVO 

Fig. 3  OPTIC  TRACK  LOOP 

A  single  axis  of  the  optio  track  systen  is  depioted  In  Pig.  3.  The 
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op«r«tortupon  s««lng  an  angular  tracking  arror  through  the  optlo  sight, 
outputs  a  rate  oonnand  through  the  thuab  transducer  to  the  sight 
controller.  The  controller  consists  of  a  propotlonal  plus  Integral 
eleaents.  The  sight  servo  then  follow  the  oosnand  and  position  the  sight. 
Since  the  sight  servo  has  a  very  vide  bandwidth  ooapared  with  this  control 
loop,  it  Is  BOdelled  as  unity.  The  outputs  froa  the  sight  controller  are 
used  together  with  the  range  Inforaatlon  froa  the  range  finder  to  generate 
the  target  state  estimates  to  direct  the  gun. 

The  lapleaentatlon  Is  the  saae  for  both  the  aslauth  and  elevation 
channels.  However,  the  two  axes  are  coupled  through  the  observation  and 
force  output  noises  to  simulate  the  Inability  of  the  operator  to  decouple 
exactly  the  two  axes. 


HQPft  YAfclPATlfiH 

During  the  field  test,  the  range  tracking  system  was  used  to  record 
the  trajectories  of  live  targets.  The  time  history  of  all  critical  systea 
variables  such  as  optical  sight  angular  postlons, sight  rate 
ooamands, target  range, as  well  as  all  parameters  related  to  the  gun  were 
recorded  on  digital  tapes.  Purtheraore,  video  fllas  taken  with  a  camera 
aounted  on  the  ooaaander's  eyepiece  (while  the  gunner  was  doing  the 
tracking)  were  aanually  reduced  to  give  tracking  error. 

Slaulatlon  validation  was  based  on  an  Incoalng  fixed  wing  aircraft 
and  a  crossing  helicopter  run.  The  target  trajectories  are  shown  in 
Figures  4  and  5.  The  target  trajectory  data  was  saoothed  and  then  fed 
into  the  Fortran  slaulatlon.  Tbs  slaulatlon  results  were  then  compared 
with  the  field  test  results  against  the  same  target.  The  comparison  were 
aade  by  both  the  Monte  Carlo  aetbods  as  well  as  by  single  run  aatoh-ups. 
Before  each  Monte  Carlo  slaulatlon  run,  the  paraaeters  listed  In  table  1 
were  randomly  seleoted  within  the  limits  shown.  For  each  tine  Inoreaent, 
the  fifth  lowest  and  the  fifth  highest  values  of  the  100  run  Monte  Carlo 
set  were  recorded  and  plotted  to  fora  the  90  percent  bounds.  The  field 
test  results  for  the  saae  variable  were  examined  to  see  whether  It  was 
within  the  90  percent  bounds.  We  have  also  provided  single  runs  which  are 
the  first  run  o/  the  one  hundred  Monte  Carlo  run. 

Fig  6  Is  the  tracking  error  which  was  aanually  reduced  from  the  video 
tape  taken  during  the  field  test  when  the  high  speed  incoalng  fixed  wing 
target  was  tracked  optically.  Fig.  7  shows  the  tracking  error  of  the 
target  by  the  Fortran  slaulatlon. 

Results  against  the  fixed  wing  alroraft  sre  presented  in  Figures 
8, 9, end  10.  Tiae  history  of  operator's  coanand  rates  and  optical  sight 
angular  postlon  In  both  azlauth  and  elevation  channels  recorded  during 
^leld  test  are  plotted  in  Figure  6.  Fig  9  shows  the  corresponding  results 
la  the  Fortran  simulation.  The  field  test  data  falls  within  the  90 
percent  bound  aost  of  the  time.  Fig  10.  presents  a  single  run  .  This 
run  shows  that  the  slmultlon  has  less  high  frequenoy  noise  than  the  field 
teat. 
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similarly  Fig.  11  ,12,  and  13  presents  the  field  test  ,  100  Monte 
Carlo  runs  and  single  run  respectively  against  the  helicopter  target.  The 
oomparlson  Is  again  quite  good. 

It  should  be  noted  that  the  time  mark  of  the  field  test  results  Is 
different  from  that  of  the  Fortran  simulation.  This  is  because  that  the 
field  test  time  is  based  on  mission  start  time  while  the  simulation  uses 
the  trajectory  tape  beginlng  as  time  zero.  However,  the  two  results  were 
carefully  lined  up  in  real  time  frame.  The  oomparlson  can  be  most  easily 
made  by  overlaying  the  curves. 

DISC0S3I0N 

Field  test  and  simulation  oomparlson  have  demonstrated  that  the 
quasl^llnear  transfer  function  representation  of  an  human  operator  works 
reasonably  well  for  both  high  speed  fixed  wing  airoraft  and  slow 
helicopter  targets.  However,  the  noise  model  still  can  be  Improved.  For 
example,  the  Independent  noise  should  be  modelled  based  on  the  typical 
human  operator 'natural  frequency  Instead  of  being  a  purely  white  noise. 


REFERENCi 


[1]  McRuer,D.T.,  Graham, D. ,Erendel,E. , and  Riesec6r,W. Jr. , 

"Human  Pilot  Dynamics  In  Compensatory  Systems,” 

Air  Force  Flight  Dynamics  Laboratory,AFPDL»*TR»65-15,1965 

[2]  Hess, R. A. , "Dual* Loop  Model  of  the  Human  Controller," 

Journal  of  Guidance  and  Control,  Vol.  1,No.  4,  1978 

C3]Klelnman,D.L. ,and  Perkins, T. R. ,  "Modeling  Human  Performance 
In  a  Time* Varying  Anti* Aircraft  Tracking  Loop,” 

IEEE  Transaction  on  Automatic  Control,  Vol.  AC*19,No.  4, August  1974. 


230 


.n  &.M  :^(S  ,  u.zx  ]a.xt 

* IHt  's*coie»  ; 


AM* 


(3os/po^  Z3fl<l  ^30)1  (  0111 


V\.-r 


;4.ta 


:i«  ^  xtu 

TIME  (cecondc  ) 


'xmr 

I 


'slf'. 


2LSt 


^139 


.  I  ^1  ^  •  •  * 

-i«Hj  < 

{TRACK 


(TRACK  ELEVATION  ANGULAR  RATE  CCf^KANO 


MSI 


u.tu 


)i.iK 


am 


^ttz 


SIG-.T  elevation  angle  WRT  GUN 


'  M  4  a:  K.*:  :i?f 


Figure  11.  Field  Test  Data  For  Helicopter. 


2  ^  6 


TRACK  AZIMUTH  ANGULAR  RATE  '.OMMANO 


AD  P00162 


Effects  of  Practice  on  Pilot  Response  Behavior 

by 

William  H.  Levison 
'ji.v:-  Seranek  and  Newman,  Inc. 

30  Moulton  Street 
Cambridge,  MA  02238 


Proceedings  of  the 

Eighteenth  Annual  Conference  on  Manual  Control 

Day  ton ,  OH 
June  8>10,  1982 


ABSTRACT 

/' 

‘^^This  study  is  directed  toward  development  of  an  analytic 
tool  for  the  design  of  training  procedures  and  for  the  evaluation 
of  trainee  performance  in  tasks  relevant  to  aircraft  flight 
management.'  Laboratory  tracking  >  data  have  been  analyzed  to 
determine  changes  in  ^pilot-related*  parameters  of  the  optimal 
control  model  that  best  correlate  with  practice  effects.  Data 
from  two  independent  studies  show  that,  with  continued  practice, 
subjects  lower  their  remnant  and  increase  their  response  gain. 
These  effects  can  be  accounted  for  primarily  by  a  reduction  of 
the  observation  noise/signal  ratio  and,  to  a  lesser  extent,  by  a 
reduction  of  the  motor  time  constant.  Preliminary  analysis 
suggests  that,  in  part,  the  apparent  practice-related  change  in 
motor  time  constant  may  reflect  a  relative  insensitivity  of 
performance  to  piloting  strategy  early  in  training  when  pilot 
noise  levels  are  high,  rather  than  a  change  in  response  bandwidth 
capabilities.  4.^ 


INTRODUCTION 


This  study  has  been  directed  toward  the  development  of  an 
analytic  tool  for  the  design  of  training  procedures  and  the 
assessment  of  trainee  performance  in  the  kinds  of  monitoring, 
decision,  and  control  tasks  required  for  aircraft  flight 
management.  A  more  specific  goal  is  to  extend  the  optimal 
control  model  (OCM)  of  pilot/vehicle  systems  [1,2]  into  a 
predictive  tool  that  relates  the  acquisition  of  continuous 
estimation  and  control  strategies  to  the  perceptual  cueing 
environment.  The  first  phase  of  this  effort,  the  results  of 
which  are  summarized  in  this  paper,  haa  been  to  analyze  existing 


239 


manual  control  data  to  determine  the  effects  of  practice  on  pilot 
response  behavior  and  to  quantify  changes  in  independent  model 
parameters  that  beat  correlate  with  practice  effects. 

Data  from  two  experimental  studies  are  analyzed.  The  study 
referred  to  as  the  "Motion  Cue  Study"  was  conducted  to  explore 
the  effects  on  pilot  performance  of  a  delay  between  platform 
motion  and  visual  cueing  [3] .  Five  groups  of  subjects  were  first 
trained  to  asymptote  under  various  motion-cueing  conditions:  (a) 
fixed-baser  (b)  combined  visual  and  motion  cueing  with  no 
additional  delays,  and  (c)  different  amounts  of  additional  delay 
added  to  the  motion  cueing.  The  subject  populations  then 
transitioned  to  the  zero-delay  condition  for  further  training. 
Data  considered  in  this  paper  were  obtained  from  the  fixed-base 
and  zero-delay  motion  populations  during  the  pre-transition 
phase. 

The  study  referred  to  as  the  "Performance  Analyzer  Study" 
was  conducted  as  part  of  a  research  project  to  develop  a  tracking 
task  for  which  performance  would  te  particularly  sensitive  to 
task-  and  environment-related  stress  (4].  The  tracking  tasks 
performed  in  this  study  were  fixed  base  and  used  a  simulated 
vehicle  for  which  the  response  characteristics  contained  an 
unstable  root  (divergence  time  constant  of  0.5  seconds).  The 
reader  is  referred  to  the  literature  for  additional  details  on 
these  two  studies. 

Four  steps  were  involved  in  analyzing  the  effects  of 
practice  on  pilot  response  behavior:  (1)  computation  of  standard 
engineering  measures  of  control  behavior  (specifically, 
describing  function  and  remnant)  at  different  stages  of  practice; 
(2)  use  of  these  measures  to  identify  Independent  model 
parameters,  (3)  statistical  analysis  to  determine  which  of  the 
apparent  practice-related  parameter  changes  are  significant,  and 
(4)  interpretation  of  parameter  changes  in  terms  of  practice- 
related  differences  in  human  operator  information-processing 
capabilities. 

The  work  reported  in  this  paper  has  dealt  mainly  with  the 
first  three  steps;  adequate  interpretation  of  results  will 
necessitate  further  research.  As  discussed  below,  this  effort 
was  to  some  extent  a  methodological  study  as  well  as  a  study  of 
practice  effects. 
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METHODOLOGY 


Parameter  Identification 


The  quasi-Newton  gradient  search  procedure  [5-7]  was  used  to 
identify  independent  —  or  "pilot-related"  — parameters  of  the 
OCM.  This  procedure  adjusts  the  independent  model  parameters  to 
minimize  a  scalar  matching  error  that  is  composed  of  time  domain 
measures  (typically^  error,  error-rate,  control,  and  control-rate 
variances)  and  frequency-domain  measures  (estimates  of  describing 
function  gain  and  phase  shift,  and  pilot  remnant) . 

Four  classes  of  model  parameters  were  identified  from  the 
tracking  data:  observation  noise/signal  ratios,  motor 

noise/signal  ratios,  time  delay,  and  motor  time  constant. 
Nomenclature  and  definitions  for  these  parameter  are  as  follows: 

Py  ■  Observation  noise/signal  ratio  relevant  to  tracking  error, 
e 

in  dB.  This  quantity  is  defined  as  the  ratio  of  the 
observation  noise  covariance  associated  with  perception  of 
tracking  error,  normalized  with  respect  to  tracking  error 
variance.  (Tracking  error  was  a  zero-mean  process.) 

PY,  ■  Observation  noise/s igial  ratio  relevant  to  perception  of 
e 

tracking  error  rate. 

PY„  ■  Observation  noise/signal  ratio  relevant  to  perception  of 
e 

tracking  error  acceleration.  This  parameter  was  identified 
for  motion-base  tracking  only;  the  subject  was  assumed  not 
to  obtain  useful  error  acceleration  information  from  visual 
cues. 

PUP  ■  Pseudo-motor  noise/signal  ratio,  in  dB,  defined  as  the 
ratio  of  pseudo  motor  noise  covariance  normalized  with 
respect  to  the  variance  of  the  commanded  control  rate.  The 
prefix  "pseudo"  signifies  a  noise  process  that  only 
influences  the  pilot's  response  strategy;  it  does  not 
reflect  an  actual  noise  process  injected  into  the  system. 
See  Reference  8  for  a  detailed  discussion  of  the  motor 
noise  aspect  of  the  OCM. 

TD  *  Time  delay,  in  seconds. 

TN  •  Motor  time  constant,  in  seconds,  which  relates  to  the 
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relative  cost  penalty  on  control-rate  variance.  An 

increasing  motor  time  constant  reflects  decreasing  response 
bandwidth. 

Independent  model  parameters  were  identified  from  data 

obtained  early  in  training  (referred  to  as  "early"  practice)  and 
after— training  to  a  nearr-asymptotic  level  of  .  mean-squared  error 
performance  ("late"  practice).  Data  from  between  2  to  4 
experimental  trials  were  averaged  for  a  given  subject  performing 
a  given  task  at  a  given  level  o^  practice.  To  minimize  the 

effects  of  learning  within  a  set  of  replicationsr  trials  yielding 
similar  mean-squared  error  scores  (for  a  given  subject)  were 
selected  for  the  early  practice  phases.  Thus,  "early"  data 

reflect  trials  in  close  succession,  but  not  necessarily 
consecutive.  There  was  no  evidence  of  learning  in  the  final 
stages  of  practice;  typically,  the  final  four  practice  trials 
were  averaged  for  the  "late"  data. 

Pilot  parameters  were  identified  for  each  subject  in  one  of 
two  ways.  First,  the  full  set  of  parameters  was  identified;  this 
procedure  is  termed  the  "unconstrained"  search  procedure.  Next, 
parameters  were  re-identified  with  the  following  constraints 
placed  on  the  search  scheme;  (a)  time  delay  fixed  at  an 
appropriate  value  for  all  subjects,  both  practice  conditions;  (b) 
motor  noise  ratio  fixed  at  the  average  value  for  early  and  late 
practice  for  a  given  subject,  and  (c)  observation  noise/signal 
ratios  constrained  to  be  the  same  for  all  observation  noise 
parameters  identified  (e.g.,  PY  ■  PY,  for  a  given  subject  at  a 

e  e 

given  level  of  practice) .  This  procedure,  which  is  termed  the 
"constrained"  search  procedure,  considers  only  the  overall 
observation  noise/signal  ratio  and  the  motor  time  constant  to  be 
influenced  by  training. 

The  constrained  search  procedure  is  justified  because,  for 
the  data  base  considered  in  this  study,  time  delay,  motor  noise, 
and  differences  among  observational  noise  variables  were  not 
significantly  influenced  by  practice.  (One  should  not  conclude 
that  these  model  parameters  were  redundant  or  non-identif iable ; 
rather,  they  were  not  indicators  of  the  learning  process.)  As 
the  reader  will  see,  results  are  more  readily  digested  if  the 
search  procedure  is  narrowed  down  to  the  important  quantities. 


* 

The  search  procedure  actually  identifies  the  relative  cost 
weighting  associated  with  control-rate  variance.  This  weighting 
is  then  converted  to  an  equivalent  motor  time  constant  for 
presentation. 
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Significance  Testing 


Two  techniques  were  employed  to  determine  the  significance 
of  practice-related  parameter  differences:  paired-difference  t- 
tests  performed  on  the  model  parameters,  and  the  qualitative 
cross-comparison  scheme  proposed  by  Levison  [6,7].  Application 
of  the  t-test  was  the  same  as  would  be  applied  to  the  basic 
tracking  data  (say,  mean-squared  error  scores) ,  except  that  the 
Identified  pilot  parameters  served  as  the  "data”*  As  a  practical 
matter,  this  procedure  was  limited  to  analysis  of  population 
means,  with  subject-paired  early/late  differences  used  in  the 

computation  of  the  "t"  statistic. 

The  cross-comparison  technique  was  applied  to  both 
individual  subjects  and  to  subject  populations.  To  perform  this 
test,  three  sets  of  model  parameters  were  identified  for  a  given 
tracking  task:  (1)  the  set  that  best  matched  the  early  data,  (2) 
the  set  that  best  matched  the  late  data,  and  (3)  the  set  that 
best  matched  the  average  of  early  and  late  performance.  Four 
scalar  matching  errors  were  computed: 

J{B,E)  ■  matching  error  obtained  from  the  early  data,  using 
parameters  identified  from  the  early  data  (l.e.,  best 
match  to  the  early  data) . 

J(E,A)  ■  matching  error  obtained  from  the  early  data,  using  the 
average  parameter  set. 

J(L,L)  ■  best  match  to  late  data. 

J  (L,A)  ■  matching  error  obtained  from  late  data,  using  the 
average  parameter  set. 

Finally,  an  average  "matching  error  ratio”  was  computed  as 
[J(E,A)/J(E,E)  +  J(L,A)/J(L,L)]/2. 

The  matching  error  ratio  relates  to  the  degradation  in 
model-matching  capability  when  an  average  set  of  parameters  is 
used  instead  of  the  best-fitting  parameters.  If  the  average 
parameter  set  matches  the  data  as  well  as  the  best-fitting  set, 
then  the  matching  error  ratio  is  unity,  and  we  accept  the  null 
hypothesis  that  there  is  no  significant  effect  of  practice  on 


* 

Significance  testing  for  individual  subjects  would  require 
parameter  identification  for  a  number  of  individual  trials  per 
subject,  which  would  generally  entail  significant  computational 
requirements. 
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pilot  parameters.  Conversely#  a  matching  error  ratio 

substantially  greater  than  unity  indicates  that  parameters  must 
be  changed  across  conditions  to  maintain  minimum  matching  error# 
and  we  reject  the  null  hypothesis. 

This  method  can  be  used  to  test  the  parameter  set  as  a 

whole#  to  test  groupings  of  parameters#  and  to  test  Individual 
parameters.  Parameters  were  tested  singly  in  this  study.  For 
each  such  test#  remaining  independent  parameters  were  re¬ 
optimized  to  minimize  matching  error.  Thus#  this  cross- 
con^arison  scheme  provided  a  conservative  test  of  significance  in 
that  it  tested  the  matching  errors  that  remained  after  the 

potential  "tradeoffs"  among  parameters  were  accounted  for. 

Because  of  the  complex  nonlinear  relationship  between  model 
parameters  and  matching  errors,  a  quantitative  transformation  has 
not  been  found  to  relate  matching  error  to  the  probability  of  the 
null  hypothesis  being  either  valid  or  Invalid.  Hence#  the 

reference  to  this  procedure  as  the  "qualitative"  test.  As  a 
matter  of  engineering  judgement,  a  matching  error  ratio  of  2.0  or 
more  was  considered  in  this  study  to  reflect  a  qualitatively 

significant  practice  effect. 


RESULTS 


Effects  o|;  Practice  on  Pilot  Response  Behav ior 


Effecr.s  of  practice  on  pilot  describing  functions  are  shown 
in  Figure  1.  Figure  la  shows  results  for  a  single  subject  from 
the  static  (fixed-base)  group  of  motion-cue  study,  and  Figure  lb 
shows  results  from  a  subject  who  trained  initially  with  platform 
motion.  Average  results  of  six  subjects  are  presented  in  Figure 
Ic.  Discrete  symbols  indicate  experimental  data,  whereas  the 
smooth  curves  are  model  matches  to  the  data. 

These  curves,  which  are  representative  of  the  entire  subject 
populations,  show  similar  trends.  Performance  obtained  early  in 
praccice,  relative  to  asymptotic  performance,  is  characterized  by 
lower  pilot  gain,  minimal  differences  in  phase  shift,  and  higher 
remnant. 

Practice-related  effects  shown  in  these  figures  should  not 
be  considered  simply  characteristics  of  the  pilot,  but  of  the 
pilot/vehicle  interaction.  That  is#  one  should  not  be  surprised 
to  find  quantitatively  (and  perhaps  qualitatively)  different 
practice  effects  for  tasks  using  substantially  different  vehicle 
dynamics.  The  goal  of  the  subsequent  model  analysis  is  to  relate 
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Figure  1. 

Effect  of  Practice  on  Pilot 
Response  Behavior 


these  changes  to  parameters  that  are  more  reflective  of  changes 
In  pilot  capabilities  and  relatively  independent  of  the  details 
of  the  tracking  task. 


Effects  of  Practice  on  Independent  Model  Parame ter s 


Table  1  shows  the  effects  of  practice  on  average  pilot 
parameters  for  the.  ..static  ,  and  motion  subject  populations 
participating  in  the  motion  study*  Results  of  the  unconstrained 
and  constrained  search  procedures  are  similar.  Both  observation 
noise  and  motor  time  constant  decreased  with  practice  for  the  two 
populations#  with  time  constant  differences  being  greater  for  the 
static  group.  Table  la  shows  negligible  changes  in  motor  noise# 
an  increase  with  practice  in  the  time  delay#  and  apparently 
greater  practice  effects  on  position-related  noise  as  compared  to 
rate-related  noise.  However#  time  delay  changes  and  differences 
between  position  and  rate  noise  were  found  to  be  largely 
insignificant#  thereby  justifying  the  constrained  search 
reflected  in  Table  lb. 

Results  of  the  significance  test  of  practice-related 
parameter  differences  are  given  in  Table  2.  The  t-tests 
indicated  that  only  observation  noise  differences  are 
significantly  influenced  by  practice;  this  was  true  tor  both  the 
static  and  motion  groups.  The  qualitative  cross-comparison  test 
confirmed  this  conclusion  for  the  motion  group.  For  the  static 
group#  however#  changes  in  motor  time  constant#  but  not 
observation  noise#  were  found  to  be  significant. 

The  discrepancy  between  the  conclusions  yielded  by  the  two 
significance  testing  methods  may  be  due#  in  part#  to  appreciable 
sub jec t-to-sub ject  differences.  Figure  2#  which  shows  parameters 
identified  for  individual  subjects#  reveals  an  apparent  negative 
correlation  between  practice-related  effects  on  observation  noise 
and  motor  time  constant  for  the  static  group.  That  is#  subjects 
exhibiting  relatively  large  changes  in  motor  time  constant  tended 
to  exhibit  relatively  small  changes  in  observation  noise#  and 
vice  versa.  This  finding  suggests  some  sort  of  tradeoff  between 
decrements  in  motor  time  constant  and  decrements  in  observation 
noise  in  the  early  stages  of  practice.  Because  the  parameter 
differences  shown  in  Figure  2  were  found  to  be  largely 
significant  (i.e.#  matching  error  ratio  greater  than  2),  this 
presumed  tradeoff  does  not  simply  reflect  an  insensitivity  of  the 
model-matching  scheme.  We  explore  shortly  the  possibility  that 
this  tradeoff  reflects  an  insensitivity  of  performance  to 
piloting  strategy. 


TABLE  1 


Effects  Of  Practice  on  Average  Pilot  Parameters, 

Motion  Cue  Study 


a)  Unconstrained  Parameter  Search 


Hotion 

Condition 


Practice 

State 


Statistic 


py. 


PY. 


PYjt 


PCP 


TO 


TN 


STATIC 


MOTION 


EABLY 


LATE 


EARLY 


LATE 


MEAN 

SO 


MEAN 

SD 


MEAN 

SD 


MEAN 

SD 


-10.5 

3.1 


'22.5 

2.1 


-15.5 

8.2 


-31.8 

0.4 


-15.6 

1.9 


-18.7 

2.3 


-41.9 

11.1 


-40.6 

10.1 


.187 

.032 


.221 

.044 


-14.9 

1.3 


-14.6 

6.6 


-16.8 

4.6 


-24.4 

1.6 


-55.4 

7.9 


■56.8 

5.6 


.152 

.083 


.192 

.024 


.205 

.084 


.135 

.021 


.115 

.006 


.099 

.024 


b)  Constrained  Parameter  Search 

I  Motion  Practice  _ PARAMETER 


Condition 

State 

Statistic 

- P? - 

W 

EARLY 

MEAN 

-15.2 

.2021 

STATIC 

SD 

1.4 

.0826 

LATE 

MEAN 

.  9 

.135 

SD 

1.0 

.022 

EARLY 

MEAN 

-15.4 

.124 

MOTION 

SD 

3.4 

.015 

LATE 

MEAN 

-24.1 

.099 

SO 

0.5 

.022 

Statistics  for  5  subjects,  static;  4  subjects,  motion; 
2-4  trials/subject. 
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TABLE  2 


Significance  Test  of  Practice-Related  Parameter 
Differences,  Motion  Cue  Study 


Parameter 


Motion 

Condition 

search 

Procedure 

Test 

Procedure 

PUP 

TD 

TN 

Unconstrained 

t-test 

N/A 

STATIC 

Constrained 

t-test 

N/A 

N/A 

N/A 

• 

Constrained 

Qualitative 

- 

N/A 

N/A 

N/A 

<k 

Unconstrained 

t-teet 

* 

MOTION 

Constrained 

t-t03t 

N/A 

N/A 

.. 

Constrained 

Qualitative 

N/A 

N/A 

- 

N/A  "  not  applicable. 

•  not  significant. 

*  =  alpha  significance  level  0.05  or  less  for  the 

h“test,  matching  error  ratio  greater  than 
2.0  for  the  qualitative  test. 


Figure  2.  Effects  of  Practice  on  Pilot-Related  Model  Parameters, 
Motion  Cue  Study 

Results  of  the  model  analysis  were  more  consistent  for  the 
performance  analyzer  study.  Table  3  shows  that  practice 
influenced  primarily  the  observation  noise/signal  ratio  for  the 
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subjects  participating  in  this  study.  Both  methods  for 
determining  significance  indicated  that  only  the  noise  parameters 
were  significantly  effected.  On  the  average#  motor  time 
constants  and  observation  noise/signal  ratios  were  lower  than 
those  obtained  in  the  motion-cue  study#  perhaps  because  of  the 
more  severe  information-processing  requirements  imposed  by  the 
unstable  plant  dynamics  used  in  the  performance  analyzer  study. 


Sensitivity  Analysis 


The  process  of  developing  ^  model  for  control-strategy 
learning  would  be  simplified  (or#  at  least#  easier  to  discuss)  if 
we  could  relate  the  process  of  skill  acquisition  to  changes  in  a 
single  independent  model  parameter.  As  suggested  above#  the 
apparent  negative  correlation  between  changes  in  time  constant 
and  changes  in  observation  noise  may  reflect  a  certain 
insensitivity  of  performance  to  variations  in  pilot  strategy. 
That  is#  what  we  measure  as  a  difference  in  motor  time  constant 
may  not  reflect  a  change  in  the  pilot's  response  bandwidth 
limitation#  but  rather  that#  early  in  practice#  the  subject 
deviates  from  optimality  in  such  a  way  as  to  give  the  appearance 
of  a  degraded  response  bandwidth. 

In  the  interest  of  developing  the  most  parsimonious  model 
possible#  let  us  postulate  the  following: 


1.  The  only  "real"  effect  of  practice  on  "pilot-related" 
model  parameters  is  to  reduce  the  observation 
noise/signal  ratio  from  an  initially  high  level  to  a 
substantially  lower-level. 

2.  The  presence  of  a  high  level  of  observation  noise 
affords  the  pilot  a  certain  amount  of  flexibility  that 
is  absent  when  noise  levels  are  relatively  low. 
Specifically#  he  has  the  option  of  reducing  his  gain 
below  would  what  be  predicted  as  "optimal"  in  order  to 
trade  control  activity  for  tracking  error#  while 
maintaining  a  near-optimal  performance  level  (where 
"performance"  is  a  weighted  sum  of  mean-squared  error 
and  control-rate) . 


In  order  to  test  this  hypothesis#  various  sets  of  "data" 
were  generated  by  the  model  and  then  reanalyzed  to  see  if 
experimental  trends  could  be  replicated.  First#  a  motor  time 
constant  of  0.1  seconds  was  specified#  and  the  observation  noise 
ratio  was  adjusted  (equal  for  position  and  rate  noise)  to  yield 
the  mean-squared  error  score  found  experimentally  on  the  average 
for  static  tracking  early  in  practice.  Nominal  values  were 
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TABLE  3 

Effects  of  Practice  on  Pilot-Related  Model 
Parameters,  Performance  Analyzer  Study 


a)  Model  Parameters 


*  Sarareh  parformed  under  following  conetrelnti; 
PVg  “  *’^6'  TO  -  .135. 

Statistics  for  6  subjects,  2-4  triale/subject. 


b)  Significance  Tests 


N/A  ■  not  applicable. 

«  not  significant. 

*  -  alpha  significance  level  .05  or  less  for  the 

t-test,  matching  error  ratio  greater  than  2.0 
for  the  qualitative  test. 

Statistics  for  6  subjects,  2-4  trials/subject 
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spacified  for  remaining  model  parameters.  Next,  certain 
manipulations  were  performed  to  force  the  pilot  model  to  modify 
its  tracking  strategy,  subject  to  the  constraint  that  total 
performance  (a  weighted  sum  of  error  and  control-rate  variances) 
not  be  materially  increased.  This  procedure  was  repeated,  with 
observation  noise  adjusted  to  reproduce  tracking  error  variance 
appropriate  to  static  tracking  late  in  practice.  Finally,  these 
model-generated  "data”  weie  then  analyzed  in  the  same  manner  as 
the  tracking  data  for  the  purposes  of  identifying  independent 
model  parameters.  .  _  _  -  _  _ 

Analysis  of  these  pseudo-data  tended  to  reflect  the  trends 
of  the  experimental  data.  Specifically,  motor  time  constants  of 
approximately  0.2  and  0.15  seconds  were  identified  for  "data" 
corresponding  to  early  and  late  practice  stages,  respectively, 
and  observation  noise  ratios  associated  with  perception  of  error 
displacement  were  somewhat  greater  than  noise  ratios  associated 
with  rate  perception. 

Thus,  there  appears  to  be  some  support  for  the  notion  that 
apparent  practice-related  changes  in  motor  time  constant  are  due 
in  part,  if  not  entirely,  to  certain  tradeoffs  in  control 
strategy  that  are  available  to  the  pilots  when  performance  is 
limited  by  high  observation  noise  levels.  Additional  work  is 
needed  to  validate  this  hypothesis;  for  example,  to  show  that  it 
also  accounts  for  results  obtained  in  the  motion  case  and  in  the 
performance  analyzer  study. 


DISCUSSION 


This  study  was,  in  part,  an  exploration  of  analysis 
methodologies  as  well  as  a  study  of  practice  (or  learning) 
effects.  We  discuss  methodological  considerations  first,  then 
proceed  to  the  discussion  of  the  results  of  primary  interest. 


Methodoloq ical  Considerations 


Within  the  framework  of  the  quasi-Newton  search  procedure, 
two  techniques  for  ident:.fying  independent  model  parameters  were 
explored;  an  unconstrained  search  in  which  all  relevant 
independent  model  parameters  are  identified,  and  a  constrained 
search  in  which  certain  parameters  are  fixed  and  others  forced  to 
conform  to  certain  interrelationships.  Both  procedures  are 
useful  and,  in  fact,  needed  in  most  instances.  In  general,  one 
must  first  perform  an  unconstrained  se  ^h  to  determine  which 
parameters  are  (and  are  not)  influt  .oed  by  the  experimental 


vac  table (s)  o£  interest.  After  parameters  have  been  identified 
in  this  manner  and  tested  for  significance,  one  can  justifiably 
Impose  constraints  on  the  search  procedure.  A  constrained  search 
then  allows  one  to  focus  on  the  important  effects  and,  as  is 
clear  from  a  comparison  of  Tables  la  and  lb,  it  greatly 
facilitates  presentation  of  the  results  of  the  analysis. 

Two  procedures  were  also  explored  for  testing  the 
statistical  significance  of  parameter  differences:  the  standard 
t-test,  -and  a-  sensitivity-  analysis  that  we  have  termed  the 
"qualitative  cross-con^ar ison"  procedure.  Both  methods  yielded 
the  same  conclusions  in  situations  where  practice  effects  were 
consistent  across  subjects.  Conclusions  were  different  when 
subject  behavior  was  inconsistent;  but,  since  we  have  no  way  of 
determining  which  method  is  "right",  it  is  prudent  to  retain  both 
techniques  in  our  repertoire  of  analysis  tools. 

To  some  extent,  the  nature  of  the  data  base  will  determine 
which  testing  procedure  to  use.  Since  the  t-test  requires  a 
number  of  replications  per  condition,  the  qualitative  testing 
procedure  must  be  used  to  compare  parameters  identified  from  two 
experimental  trials  (as  might  be  desired  if  significant  trial-to- 
trial  learning  occurs).  The  qualitative  procedure  can  also  be 
used  to  minimize  computational  requirements  when  multiple  trials 
per  condition  are  available,  as  this  method  allows  one  to 
directly  test  the  replica te-averaged  data. 

Either  method  may  be  used  for  testing  average  results  for  a 
subject  population.  If  parameters  are  identified  for  individual 
subjects  first  (a  recommended  procedure  if  substantial  subject 
differences  are  expected)  ,  applying  the  t-test  to  subject-paired 
parameter  differences  avoids  the  necessity  for  further  model 
analysis.  If,  on  the  other  hand,  parameters  have  been  identified 
only  for  subject-averaged  data,  the  cross-comparison  scheme  must 
be  used,  as  there  is  only  one  set  of  model  parameters  per 
experimental  condition. 


Practice  Ef fee ts 


There  are  a  number  of  reasons  for  attempting  to  characterize 
the  effects  of  practice  in  terms  of  a  single  independent  model 
parameter.  First,  it  is  this  author's  opinion  that,  in  general, 
the  model  having  the  greatest  potential  for  predictive  capability 
is  the  most  parsimonious  model  —  i.e.,  the  model  that  explains 
the  gr^-^atest  amount  of  experimental  data  with  the  fewest 
independent  parameters.  Reduction  of  practice  effects  to  changes 
in  a  single  Independent  parameter  does  not  necessarily  impose 
limitations  on  modelling  the  complexity  of  the  learning  process. 


We  have  shown  thatr  at  the  very  least,  pilot  gain  and  remnant  are 
influenced  by  practice;  one  may  reasonably  suspect  that  more 
subtle  aspects  of  the  operator's  performance  capabilities  —  such 
as  the  accuracy  and  precision  of  his  internal  model  of  the  task 
structure  and  requirements  —  are  also  modified  during  the 
learning  process.  Presumably,  these  factors  can  be  treated  as 
dependent  model  parameters  »  i.e.,  aspects  of  behavior  that  can 
be  predicted  and  need  not  be  pre-spec if led. 


Another  reason  for  focussing  on  a  particular  model  parameter 
is  that  only  one  parameter  --  observation  noise  —  was 
consistently  influenced  in  a  significant  manner  by  practice  for 
the  data  base  explored  in  this  study.  Changes  in  motor  time 
constant  were  much  less  consistent,  varying  from  subject-to- 
subject.  Hence  the  hypothesis,  at  least  partially  supported  by 
sensitivity  analysis,  that  changes  in  motor  time  constant  reflect 
a  relative  insensitivity  of  overall  closed-loop  performance  to 
changes  in  piloting  strategy  in  the  high  (pilot)  noise 
environment  characteristic  of  early  stages  of  practice. 

Finally,  practice-related  changes  in  observation 

noise/signal  ratio  make  more  intuitive  sense  than  practice- 

* 

related  changes  in  motor  time  constant.  Recall  that  observation 
noise  is  the  mathematical  device  by  which  we  account  for  most  of 
the  stochastic  portion  of  the  pilot's  response  ("pilot  remnant"). 
Thus,  observation  noise  reflects  time  variations  and 
nonlinearities  in  the  pilot's  response  strategy  as  well  as 
Injected  noise.  It  is  reasonable  to  assume  that,  with  continued 
practice,  the  operator  varies  his  response  strategy  less  during 
the  course  of  an  experimental  trial,  develops  a  more  stable 
internal  model  of  the  task  structure,  and  learns  to  respond  in  a 
more  linear  fashion. 

Analysis  of  various  data  bases  suggests  that  the  motor  time 
constant  is  not  a  truly  independent  model  parameter  In  the  sense 
of  representing  an  inherent  human  operator  information-processing 
limitation.  It  appears  to  reflect,  in  part,  the  operator's 
adaptation  to  the  task  environment.  For  example,  this  parameter 
appears  to  vary  in  a  systematic  manner  with  the  bandwidth  of  the 
plant  dynamics  (7] .  In  addition,  analysis  of  the  data  obtained 
from  the  motion-cue  study  showed  that  the  motor  time  constant 
decreased  almost  immediately  by  about  one-third  when  the 


* 

One  might  reasonably  expect  time  delay  to  decrease  with 
practice.  However,  practice-related  changes  in  this  model 
parameter  were  inconsistent  and  not  statistically  significant. 
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subjects,  trained  initially  fixed-base,  were  provided  with 
concurrent  visual  and  motion  cues.  It  is  highly  unlikely  that  an 
inherent  inability  or  reluctance  to  generate  large  rates  of 
change  of  control  would  suddenly  be  modified. 

These  results  lead  to  an  alternative  hypothesis  concerning 
variations  in  motor  time  constant;  specifically,  that  the  motor 
time  constant  reflects,  in  part,  limitations  on  the  operator's 
ability  to  construct  an  internal  model  of  the  task  environment. 
As  information  to  the  operator  is  improved,  either  by  extending 
system  bandwidth  or  by  enhancing  perceptual  cueing,  the  more 
accurate  and  precise  the  internal  model,  and  the  lower  the  motor 
time  constant. 

As  a  final  comment,  the  reader  is  reminded  that  the  attempt 
to  characterize  the  learning  process  in  terms  of  variations  in 
one  or  two  independent  model  parameters  is  strictly  a  short-term 
research  objective  that  is  intended  to  provide  some  insights  into 
the  learning  process  and  to  point  the  way  to  further  research. 
The  long-term  goal  is  to  develop  a  model  that  will  allow  one  to 
predict  the  effects  of  task  environment  —  especially  perceptual 
cueing  —  on  the  rate  at  which  the  operator  learns  appropriate 
estimation  and  control  strategies.  It  is  anticipated  that  the 
next  phase  of  this  study  program  will  be  to  explore  hypotheses 
regarding  the  operator's  ability  to  construct  his  internal  model 
of  the  task  environment. 
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Extended  Abstract 

In  the  past,  the  longitudinal  handling  qualities  of  an  aircraft  were 
determined  almost  entirely  by  the  modal  characteristics  of  thq  classical 
rigid  body  modes  (short  period  and  phugold).  These  mode^^omlnate 
ventlonal  aircraft's  dynamics  and  their  modal  parameters  (I.e.,  damping  and 
natural  frequency exhibit  a  definite  correlation  with  pilot  opinion 
ratings.  Unfortunately,  beyond  the  realm  of  conventional  aircraft,  criteria 
based  on  these  parameters  alone  are  Inadequate,  iiu^ddltlon  of  other  modes. 


(♦»«y-be^ue 


shown  to  seriously  affect  pilot  opinion  rating. 

In  the  early  70'$,  Neal  and  Smi th "[ij't^ht  a  solution  to  this  high- 
order  system  problem  by  ^p11ot-1n-the-loop-analys1s^.  Reviewing  pilot 
comments,  the  Neal -Smith  Investigation  drew  on  some  Important  hypotheses: 
"^lot  rating  Is  a  strong  function  of  the  pilot  compensation  required  to 
achieve  good  low  frequency  performance  and  the  oscllla.tpfv  tendencies,  of 
^the  pilot-vehicle  system.^*^ They  developed  a  closed-loop  methodology  to 
extract  measures  of  the  desired  quantities  (I.e.,  pilot  compensation, 
oscllatory  tendencies),  and  these  measures  were  shown  to  correlate  with  pilot 
ratings  of  the  57  configurations  flight  tested.  The  measures  are  the 
resonant  peak  of  the  closed-loop  pilot-vehicle  frequency  response,  and  the 
pilot's  phase  compensation  at  the  closed-loop  bandwith  (see  Figure  1). 
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Unfortunately,  the  methodology  suffers  from  difficulty  in  obtaining 
the  parameters  of  a  pilot  describing  function,  taken  to  be  a  simple  lead- 
lag  with  transport  delay  and  feed  forward  gain,  (see  Fig.  2).  These  parameters 
are  chosen  such  that  certain  closed-looped  objectives,  set  forth  by  Neal 
and  Smith,  are  met  by  this  model  of  compensatory  pitch-attitude  tracking 
task.  Choosing  these  parameters  poses  the  problem.  The  algorithm  can  often 
become  a  graphical  nightmare  and  lead  to  non  unique  results.  However,  the 
overall  hypothesis  has  merit,  and  is  considered  by  many  handling  qualities 
researchers  as  a  most  promising  technique.  So  extending  the  method  to  yield 
unique  results  in  a  straight  forward  fashion  would  appear  most. ^  useful .  This 
is  the  subject  of  this  j 

Therefore,  the  goal^  f»>to  present  an  alternate  method  for  finding  the 
quantitative  handling  quality  parameters  recognized  as  important  by  the 
Neal-Smith  study.  ^Ile  further  confirming  the  Neal -Smith  hypothesis^^his 
paper  develops  a  methodology  that  expresses  directl^^he  pilot's  objective 
in  attitude  tracking.  Mere  importantly^  J^e  method^Vel ieves  the  researcher 
of  the  tedious  task  of  finding  pilot  model  parameters/^ and  141  fact^yi elds  a 
better  model  that  may  be  applied  directly  to  closed-loop  criterion. 

In  1970,  Kleinman,  Barron,  and  Levison  published  a  mathematical 
model  of  human  response  using  optimal  control  and  estimation  theory.  We 
will  show  that  by  this  modeling  approach  we  obtain  a  better  pilot  model 
that  is  easier  to  obtain,  and  in  so  doing  incorporate  multivariable,  time- 
domain  techniques  directly  with  the  classical  approaches,  and  specifically 
the  Neal-Smith  method. 

Use  of  the  optimal  control  model  (OCM)  (see  Fig.  3)  reflects  more 
correctly  the  actual  experimental  situation.  The  OCM  incorporates  the 
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visual  threshold  effects,  as  well  as  time  delay  and  neuromuscular  lag 
associated  with  the  human  pilot.  More  Importantly,  the  OCM  can  ie  used 
to  predict  complex  pilot  compensation  likely  to  be  present  in  tte  control 
of  high-order  dynamics.  In  contrast  to  being  restricted  to  only  '=ad-lag 
compensation.  Finally,  the  objective  of  the  pilot  In  the  tracklrg  task 
had  to  be  Inferred  Indirectly  In  the  analysis  of  Neal  and  Smith,  but  Is 
expressed  directly  In  the  objective  function  of  the  OCM.  Specifically,  the 
objective  function  found  (from  previous  research)  to  be  representative  of 
a  pilot's  In  the  task  may  be  expressed  as 

J(F5)  •  y  j  (16  (e^  -  0)^  +  (e^  -  e)  +  g(^5)^)dt 

where  (0^  -  0)  Is  the  attitude  error,  and  Is  the  stick  force  input  of 
the  pilot. 

Admittedly,  the  OCM  block  diagram  varies  drastically  from  tl'.e  classical, 
single  loop  structure.  However,  the  OCM  may  still  be  applied  to  estimate 
the  pilot's  equalization  In  a  compensatory  tracking  task.  To  substantiate 
this  fact,  we  have  used  the  OCM  to  estimate  spectral  densities  of  the 
system's  signals  (e.g.  plant  and  pilot  Input  and  outputs)  and  then  compared 
tracking  errors  from  both  model  structures.  Integrating  the  spectral  density 
over  the  frequency  domain  gives  the  variance  of  the  signals  In  qjestlon  by 
applying  the  following  relation. 

^o 

If  the  compensatory  describing  function  Is  accurately  est1r=ted  via 
the  OCM  we  should  obtain  comparable  error  and  state  variances.  And  Indeed 
the  estimated  compensatory  tracking  describing  function  produced  tracking 
errors  within  4%  of  the  OCM. 
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By  validating  that  the  OCM  can  be  used  to  estimate  the  compensatory 
tracking  task  describing  function,  one  has  the  flexibility  to  study  the 
pilot  frequency  response  in  the  same  framework  used  in  the  Neal -Smith 
report.  Hence,  both  open-looped  and  closed-looped  frequency  responses  are 
available  along  with  the  pilot  frequency  response.  Alsoi  the  desired 
measures  of  pilot  phase  compensation  and  closed-loop  resonance  peak  may  be 
directly  extracted  from  the  OCM.  And  finally,  the  link  has  been  made  between 
the  frequency  domain  and  the  time  domain  and  multivariable  systems  techniques. 

Complete  results  are  presented  in  Reference  [3]. 
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ABSTRACT 

Human  operators  play  critical  Information  processing  and  decisionmaking 

3 

roles  in  command,  control  and  communication  (C  )  systems.  These  systems  are 

characterized  by  extreme  con^lexity,  and  functional  cmd  geographic  diversity. 

In  this  paper,  we  present  a  methodology,  based  on  the  concept  of  hierarchical 

decomposition,  for  the  quantitative  analysis  and  design  of  such  systems.  Our 

2 

approach  begins  with  an  analytic  decomposition  of  the  C  process  into 

functions,  along  with  the  concomitant  association  of  objectives  to  functions. 

The  ftinctions,  along  with  the  associated  objectives,  in  turn,  are  subdivided 

into  well-defined  entities  or  tasks  that  are  amenable  to  analytic  modeling 

and/or  empirical  description.  The  task  level  analysis  is  Integrated  into 

2 

evaluation  of  specific  C  functions.  The  existing  modeling  technology  for 
task  emalysis  and  integration  is  discussed,  along  with  the  research  needed  to 
augment  this  technology  base  to  ^u:rive  at  a  unified  methodology  for  the 

3 

description,  emalysls  euid,  ultimately,  the  design  of  C  systems. 
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ABSTRACT 


A  method  for  determining  basic  visual  cue  requirements  for  piloted 
flight  control  tasks  is  presented.  The  method  emphasizes  a  classical, 
locp-by-loop  synthesis  procedure  for  determining  required  pilot 
equedization  and  open-loop  crossover  frequencies  in  well-defined  flight 
control  tasks.  The  results  of  recent  pertinent  laboratory  tracking 
experiments  are  discussed  involving  measurement  of  pilot  dynamics  in  single 
and  multiple-loop  tasks.  The  role  of  pursuit  and  preview  tracking  in  the 
inner  attitude  loops  of  multiple-loop  tasks  is  outlined  and  their 
importance  in  determining  visual  cue  and  display  requirements  is  discussed. 
It  is  finally  shown  that  flight-director  laws  evolve  quite  naturally  via 
this  procedure. 
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/  ABSTRACT  "■  _  / 

'"Validation  of  a  ir.odel-based  methodology  for  the  design  and  evaluation  of 
advanced  cockpit  information-display  systems  is  undertaken.  The  i^echnxque  is 
applied  to  determine  information  and  display  requirements  in  an  AlO  terrain¬ 
following  flying  task.  Four  candidate  display  systems,  including  a  flight 
director  system,  are  proposed  and  rank-ordered  across  dimensions  of  workload 
and  performance.  Validation  of  the  analytical  predictions  is  accomplished 
through  nun- in  the- loop  simulation  experiments.  It  is  concluded  that  the 
methodology,  which  can  determine  the  limit  information  to  the  best  quantities 
needed  by  the  pilot  to  perform  effectively,  can  be  a  valuable  tool  in  the 
development  oT  advanced  cockpit  information  systems. 

INTRODUCTION 


The  increased  complexity  of  advanced  tactical  air-to-air/close  air  support  air¬ 
craft  lias  elevated  the  pilot  to  a  role  of  systems  manager.  The  pilot  must 
allocate  sensors,  evaluate  threats,  select  weapons,  employ  ECM,  etc.,  in  addi¬ 
tion  to  the  omnipresent  task  of  flying  the  aircraft.  The  increase  in  the 
number  of  systems  and  subsystems  has  required  the  display  of  increasingly  more 
information  to  the  pilot  about  his  aircraft  and  the  environment.  Unfortunately, 
this  has  increased  the  pilot's  workload.  A  methodology,  therefore,  is  required 
to  determine  and  limit  information  to  the  best  informational  set  needed  by  the 
pilot  to  perform  his  various  tasks  effectively. 

If  pilot  .ind  aircraft  are  to  function  as  an  effective  combat  system,  it  is 
essential  that  the  workload  associated  with  the  basic  flying  task  be  reduced 
through  either  display  or  control  automation.  Thus,  the  pilot  would  be  in  a 


*  This  work  performed  under  the  following  contract  to  AMRL:  F33615-80-C-0528 
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position  where  he  can  allocate  a  greater  fraction  of  hia  capacity  for  decision 
making  relative  to  vraapon  aissignment,  etc.  Nowhere  is  this  problem  more 
critical  than  in  high-speed,  low-level,  adverse-weather  interdiction  where  the 
vforkload  demands  of  the  flying  tasks  aure  severe. 

The  design  of  automated  control/display  systems  for  reducing  workload  in 
piloting  tasks  is  generally  accomplished  through  extensive  recourse  to  man-in- 
the  loop  simulations.  This  can  be  an  expensive  and  time-consuming  approach, 
especially  when  large  numbers  of  competing  designs  and/or  parameter  sets  must 
be  evaluated  and  iterated.  While  simulation  is  ultimately  necessary  in  the 
deyelopnent  of . control/display . systems ,  it  would  be  desirable  to  have  -a-computer- 
based  tool  that  could  perfera  a  preliminary  evaluation  on  a  wide  variety  of 
systems  on  a  relative  performance  basis.  In  this  manner,  one  would  only  need 
to  retain  those  systems  exhibiting  promise  for  further  evaluation  by  manned 
simulation. 

A  model/computer-based  methodology  heis  recently  been  proposed  [1-2]  that  offers 
considerable  potential  for  application  to  tactical  aircraft  display  systems 
design  and  evaluation.  Although  this  methodology  has  been  applied  to  ramk- 
order  control/display  systems  for  a  CH-47(1],  the  design  technique  has  remained 
largely  unvalidated  due  to  the  lack  of  subsequent  manned  simulation  to  assess 
the  preliminary  analytic  results.  In  this  study  the  design  procedure,  bls  pro¬ 
posed  by  Klsinman  and  Curry,  is  extended  to  a  practical  cockpit  scenario.  Sub¬ 
sequently,  we  validate  the  model  predictions  via  man-in-the-loop  simulation 
experiments.  The  piloting  control  task  considered  is  a  representation  of  a 
zero-visibility,  high-speed,  low-level  terrain  following  scenario  with  an  AlO 
aircraft.  The  aircraft  dynamics  are  approximated  by  their  short-period  longi¬ 
tudinal  equations  in  the  analysis  and  simulation. 

The  foetts  of  this  study  is  on  display,  design,  and  evaluation,  including  optimal 
synthesis  or  aggregation  of  information  states,  for  the  pilot  control  task.  The 
design  methodology,  when  applied  to  display  systems  evaluation,  follows  a  three- 
level  procedure.  At  the  first,  or  information  level,  the  methodology  determines 
the  relative  importance  of  each  system  variable  to  closed-loop  task  performance 
and  determines  the  optimal  synthesis  of  information  in  the  contex  of  a  flight 
director  signal.  At  the  second,  or  display  element  level,  the  information 
requirements  are  integrated  to  propose  several  different  realistic  display 
systems.  Human  generated  information  processing  limitations  are  Included  at 
this  level,  and  for  each  cjuidldate  design,  performance  versus  workload  curves 
are  generated.  The  different  display  systems  are  then  rank-ordered  across 
dimensions  of  performance  and  workload.  The  proposed  displays  that  resulted 
via  the  application  of  the  methodology  to  the  terrain  following  scenario 
included:  (1)  a  terrain  predictor/flight  path  vector  display,  (2)  a  tunnel 

display,  (3)  an  integrated  tunnel -predictor  display,  and  (4)  an  optimally 
designed  flight  director  display. 

nie  display  format  level  is  the  third  and  final  phase  of  the  design  process. 

Here,  specific  display  formats  are  suggested  for  the  presentation  of  the  candi¬ 
date  display  systems,  guided  by  the  sensitivities,  attentions!  demands,  etc., 
that  are  predicted  at  the  display  element  level.  The  format  level  is  the 
precursor  to  manned  simulation  experiments.  In  this  effort,  a  man-in-the-loop 


experimental  program  was  conducted  at  the  University  of  Connecticut  to  evaluate 
the  four  candidate  display  systems.  The  objective  of  these  experiments  was  to 
validate  the  overall  display  design  procedure,  including  the  analytic  rank- 
ordering,  the  workload  assessment,  and  the  flight  director  design  synthesis 
processes. 

The  analytical  nuclei's  to  the  display  design  methodology  is  the  Optimal  Control 
pilot  Model  (OCM)  [3]  - 15]  .  A  detailed  description  of  the  OCM,  in  conjunction 
with  the  three-level  display  design  process,  is  given  in  [6].  In  this  paper 
we  first  introduce  the  control  task  of  interest,  including  the  AlO  aircraft 
dynamics  and  the  tarrian  profile  characteristics.  We  a^ly  thm  the  display 
design  procedure,  which  yields  the  major  analytical  results  of  this  study, 
including  the  predictions  of  attentional  allocation,  workload  demands,  and 
performance  rank-ordering.  Finally,  the  experimental  program  is  described, 
eund  the  experimental  results  discussed. 


APPLICATION  OF  THE  CONTROL  TASK  TO  THE  OCM 


A-10  LONGITUDINAL  AIRCRAFT  DYNAMICS 

As  indicated,  the  control  task  of  interest  is  high-speed  terrain  following  for 
a  representative  low-level  attack  flight  condition,  ^e  basic  set  of  longi¬ 
tudinal  equations  being  used  is  the  short-period  dynamics.  Ihese  are  the 
perturbation  equations  written  about  straight  and  level  flight,  and  they 
describe  the  aircraft  longitudinal  rotations  about  its  center  of  mass. 

The  (two-degree  of  freedom)  transfer  functions  of  interest  are  (7) 


a 
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(8) 
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d(3)  -  s2  -  (U^M;^+Z^tM_^)s  +  (MqZ„-U^M^)  (3) 

where  q  ■  aircraft  pitch  rate,  a  ■  angle  of  attack,  •  nominal  air  spaed, 

6  -  elevator  angle,  and  Z^,  M^,  M  ,  M^,  Z^  are  the  pertinent  stability 
derivatives. 

In  the  present  work  the  stability  derivatives  were  derived  from  data  currently 
used  on  the  Aerospace  Systems  Division  A-10  nonlinear  hybrid  simulation,  and, 
the  numerical  values  are  given  in  (6)  .  "nie  nominal  air  speed  U^  ■  468  ft/sec. 

In  addition,  the  aircraft  pitch  angle,  0,  and  its  altitude,  h,  are  necessary  in 
the  modeling  process.  Therefore 

6  ■  q  ;  h  ■  0  (0-q) 
o 
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TERRAIN  PATH  MODEL 


The  next  step  is  to  select  an  appropriate  terrain  path  model  that  serves  as  the 
excitation  "signal"  to  the  system.  An  easily  Implemented  one  dimensional  model 
for  the  terrain  height  11  as  a  function  of  time  consists  of  a  Markov  process 
passed  through  a  2nd  order  filter*  [6] .  Ihe  Markov  process  is  generated  by 

2U  2U 

zit)  +  z(t)  -  C(t)  (5) 


where  ((t)  is  a~white  Gaussian  noise,  and  X  represents  the  spatial  terrain 
variations.  Next,  z(t)  is  filtered  through 


"  s2+2CwU  s+w^U2 
o  o 


where  w -2^0  is  the  natural  frequency  of  the  terrain  (D  «  "terrain  period") 
and  c is  the  damping  ratio.  In  order  to  represent  a  realistic  terrain  profile, 
the  terrain  parameters  are  selected  appropriately  [6].  Ohe^ parameter  values 
chosen  to  give  the  most  appealing  terrain  characteristics  where 

D  -  10000'  ;  X  -  D/iT  ;  C  -  l/^~2 

Ihe  white  noise  (C(t))  intensity  was  chosen  to  yield  a  reasonable  terrain  RMS 
value  of  —136  ft. 

OCM  APPLICATION 

Ihe  aircraft  dynamics  and  the  terrain  states  are  combined  into  a  single  state 
equation  as  required  by  the  OCM.  The  augmented  state  is  defined  as 

x*  ■  (n  n  n  o  q  9  e)  (7) 

where  e(t)«  flight  path  error  *  II(t)  -  h(t).  The  total  state  space  equation 
is  now 

x(t)  -  Ax(t)  +  B«(t)  +  E5(t)  (8) 


The  term  II  should  represent  a  spatial  rather  than  temporal  terrain  model.  How¬ 
ever,  assuming  a  constant  velocity,  U  ,  and  neglecting  the  flight  path  flactua- 

tions,  we  can  write  n(r)=:n(U^t)-U  11  (t?,  where  rrU^t  represents  the  traveled 

o  o  o 

distance. 
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'Hi*  numerical  values  of  A,  B,  E  are: 


0 

0 

-.025 

0 

0 

0 

0 


1 

0 


0 

1 


-.21  -.71 


0^(*  M.^N  ) 
O  w  w  w 


t 

II5* 


5  0  w 


0 

0 

0 

1 


0 

0 

0 

0 


0 

0 

0 

-1.37 


0 

0 

0 

1 


-3.08  -1.68 
0  1 
8.17  0 


0 

0 

0 

0 

0 

0 

-8.17 


•] 


0 

0 

0 

0 

0 

0 

0 


Iio»  *0 


B'  •  [O  0  0  -0.06  -6.84  0  o] 

E'  -  [O  0  .025  0  0  0  o] 


'Hie  terrain  following  task  requires  the  pilot  to  follow  the  path-over-terrain 
I((t),  as  closely  as  he  can,  subject  to  his  inherent  limitations.  Thus,  the 
quantity  he  should  minimize  is  the  flight  path  error  (FPE)  e(t).  In  addition, 
the  pilot  should  avoid  large  vertical  acceleration  values,  or  g's.  These 
requirements  on  e(t)  and  g(t)  (or,  equivalently  on  q(t}}  are  expressed  in  the 
cost  functional  associated  with  the  OCM,  with  the  pilot's  subjective  weightings 
q^  and  q^,  viz. , 

J(6,f)  -  E{q^e2(t)  +  q^q2(t)+  qj62(t) )  ,  (9) 

where  the  control  rate  weighting,  q^,  is  detexmined  by  the  pilot's  neuromuscular 
time  constant  (3]-(6].  The  cost  functional  J(6,f)  is  minimized  with  respect 
to  the  control  i  and  the  attentional  allocation  vactor  f. 
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nominal  altitude  of  the  trajectory  above  the  terrain  (II  (t))  the  aircraft 
must  follow  is  200  ft.,  and  we  assvune  that  the  maximal  excursion,  or  FPE,  should 
be  no  more  than  20%,  or  e^^  40  ft.  Also,  we  assume  that  the  maximal  vertical 

acceleration  to  be  tolerarea  by  the  pilot  is  ■  Ig  ■  32.2  ft/sec^.  Thus, 

we  compute  the  FPE  and  pitch  rate  weighting  according  to  (l],(2]-(6],  viz.. 
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The  assignskent  of  the  neuromuscular  time  constant  ■  .15  sac  completes  the 
specification  of  the  cost  functional  Eq.  (9).  It  must  be  indicated  that  J 
is  the  "nominal"  cost  functional.  With  new  display  systems  incorporated  in  the 
information  set,  it  is  possible  that  the  pilot  will  attes^t  to  minimize  addi¬ 
tional  indicators.  This  will  be  explained  in  detail  in  the  sequel. 


DISPLAY  SYSTEMS  DSSIGH 

He  present  now  the  major  analytical  results  of  the  display  systems  design  for 
the  candidate  terrain-following  task. 

INFORMATION  LEVEL  AMALYSIS 


The  information  level  analysis  is  us^d  to  determine  information  requirements  in 
the  preliminary  stages  of  display  design  and  is  the  cornerstone  to  the  sub¬ 
sequent  display  level  analysis.  There  are  two  basic  tasks  at  the  information 
level:  the  information  requirements  assessment  and  the  flight-director  design. 

Information  Requirements 

At  this  step  we  usums  that  all  state  variaUcles,  and  possibly  their  rates  are 
accessible  to  the  pilot.  Only  the  plausible  rate  variebles  should  be  considered. 
After  some  preliminary  emalysis,  the  following  set  of  variables  was  explicity 
considered: 


y'  •  [n  ii  fl  e  e  h  h  e  q]  (10) 

In  the  OCM  application  we  use  the  cost  functional  defined  by  Eq.  (9) .  The 
resulting  terrain  following  performance,  in  terms  of  absolute  values  of  the 
flight  path  error,  is  not  of  ismediate  interest  at  this  level.  We  are 
interested  in  the  relative  importance  of  each  state  variable  to  the  control 
task.  Thus,  the  performance  index  (9)  is  minisuzed  subject  to  £f  .  ■  f^, 
where  f^^  is  the  attentional  allocation  to  the  ith  indicator.  This  procedure 
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is  repeated  for  several  values  of  control  attention,  fg,  and  the  sujnmation  is 
taken  over  the  nine  elements  of  Eq.  (10).  The  optimal  fgi  that  ensue  provide 
the  relative  importance  of  each  of  the  states,  i.e.,  the  information  require¬ 
ments  for  the  control  tas)(. 


The  OCM  analysis  yields  the  relative  attentional  allocation  •  siinnnari- 

xed  in  Table  1  and  Figure  1.  The  attentional  allocations  ue  examined  at  four 
levels  of  total  control  attention,  fg  ■  0.9,  0.7,  0.5,  0.3.  ITie  only  variables 
^at  coDsnand  significant  pilot  attention  are  the  terrain  “vertical  acceleration" 
n(t),  the  FPE  rate,  e(t)  ,  and  the  FPE  e(t).  All  other  system  states  demand 
negligible  attention  in  the  pilot  model. 


TABLE  1.  RELATIVE  ATTENTIONAL  ALLOCATION- 
INFORMATION  LEVEL 


f 

c 

fVf 
e  c 

f  /f 

e  c 

0.9 

0.46 

0.  34 

0.1 

0.7 

0.46 

0.36 

0.1 

0.5 

0.42 

0.  36 

0.1 

0.3 

0.37 

0.  33 

0.1 

Figure  1.  Relative  Attentional 

Allocation-Information  Level. 

Notice  that  there  is  a  consistency  in  these  results,  i.e.. 


e  n  e 

*■  const.  ,  ^  a  const.  ,  ar  const. 

‘c  ‘c  ‘c 

Thus,  the  relative  importance  of  the  key  state  variables  does  not  change  over 
different  levels  of  control  attention  fg. 

The  results,  which  indicate  that  n(t),  e(t) ,  and  e(t)  is  the  critical  informa¬ 
tion  base,  must  now  be  interpreted.  A  major  design  issue,  at  this  point,  is 
in  determining  whether  or  not  a  separate  display  of  each  critical  variable  is 
required  for  use  by  the  pilot.  It  is  clear  that  a  FPE  Indicator  should  be 
included  since  it  is  essential  that  the  pilot  knows  his  instantaneous  position 
with  respect  to  the  desired  path  IKt) .  Such  a  display  is  easily  constructed 
using,  e.g. ,  a  radar  altimeter.  Also,  the  pilot  can  easily  extract  the  FPE 
rata  from  a  well  designed  display  of  e(t),  and  therefore,  a  separate  e(t) 
indicator  is  not  needed. 

The  major  portion  of  the  pilot's  attention  is  allocated  to  11  (t).  In  practice, 
this  variable  is  difficult  to  derive  and  display  explicity.  Also,  it  is  not 
clear  how  such  a  display  might..be  used  by  the  pilot.  One  must,  therefore, 
synthesize  a  display  in  which  IKt)  will  be  incorporated  in  a  practical  manner. 
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On*  interpretation  of  the  requirement  for  rate  information  II  (and  e)  is  the 
necessity  to  display  the  path-over- terrain  at  a  future  time,  l.e.,  at  some 
distance  ahead.  Such  displays  will  be  synthesized,  modeled,  and  compared  at 
the  display  element  level. 

Flight  Director  Design 

The  basic  concept  of  a  flight  director  is  to  provide  the  pilot  with  (synthesized) 
information  that  is  useful  for  control,  thus  rendering  the  piloting  tas)c  easier 
in  some  sens*.  This  section  describes  the  flight  director  design  procedure 
that  uses  the  quadratic  synthesis  technique  of  the  OC31  to  determine  the  optimal 
-  (linear)  ~  aggregation  of  system  states  to  be  used  as  a  display. 

The  flight  director  signal  is  a  linear  combination  of  the  system  states, 

(11) 

The  gains  h  are  chosen  so  that  if  ypQ(^)  kept  “small"  by  the  pilot,  the 
resulting  aircraft  motion  will  be  desirable.  Since  the  pilot  is  in  control  of 
the  vehicle,  there  are  two  issues  that  relate  to  the  harmony  between  ypo(t)  and 
pilot  response.  The  first  concerns  the  nature  of  the  control  task  as  viewed 
by  the  pilot.  Thus,  the  task  of  keeping  ypQ(t)  small  should  not  conflict  with 
the  overall  pilot-control  task  requirements.  The  second  issue  relates  to  the 
required  form  of  the  pilot  compensation,  as  y^n  snd  6  are  in  one-to-one  corre¬ 
spondence.  Prom  a  reduced  workload  point  of  view,  one  should  design  a  flight 
director  signal  ypQ(t)  such  that  the  transfer  function  from  input  6(t)  to  ypQ(t) 
is  approximately  K/s.  The  required  pilot  compensation  would  then  be  simple  pro¬ 
portional  feedback 

♦  ypjj(t)  (12) 

From  the  QCH,  the  pilot's  control  strategy  is  given  by 

+  6  -  -Lx(t)  +  v^(t)  (13) 

where  x(t)  is  the  state  estimate,  V{(t)  is  a  whit*  motor  noise,  and  the  gains 
L  (and  T)|)  are  obtained  by  minimizing  the  cost  function  J(6)  that  is  associated 
with  the  terrain  following  task,  Eq.  (9).  To  begin  with,  we  suggest  the  obvious 
design  choice 

ypjj(t)  -  Uc(t)  (14) 

i.e.,  h'  ■  L.  Such  a  design,  however,  does  not  consider  the  possibility  that 
the  flight  director,  once  added  to  the  display  panel,  modifies  the  pilot's 
control  task  and  hence  changes  the  cost  functional  J(5) .  Excluding  yp^  from 
the  cost  functional  implies  that  the  pilot's  control  objectives  are  basically 
the  same  as  before  introducing  this  signal.  This  is  not  a  reasonable 
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assumption.  Indeed,  including  the  yp^  with  J({),  in  addition  to  the  other 
tents,  implies  that  one  of  the  pilot's  direct  control  objectives  is  to  beep 
the  yp0  small.  Thus,  we  assume  that  the  director  signal  ypQ  is  explicitly 
controlled. 

The  control  cost  functional,  modified  to  weight  deviations  of  ypo(t)  is  now 


J*  (6) 


J(«)  +  E  |qpDyro^(t) 


(15) 


The  weighing  term  is  selected 


q 


FD 


y 


1 

— z — 

FO,max 


(16) 


to  be  consistent  with  the  choice  of  the  qy^^'s.  The  maximal  flight  director 
excursion  is  computed  according  to  the  rule 


y 


FD,max 


,max 


(17) 


where  the  1^  are  the  entries  of  the  gain  vector  L,  and  the  is  0  or  1  to 
indicate  which  variables  are  of  concern  in  forming  ypi>,max*  select 

II  if  Xi  is  a  positional  variable 
0  if  x^  is  a  rate  variable 

Thus,  the  flight  director  signal  is  at  its  maximum  value  when  all  error  dis¬ 
placements  are  at  their  design  limits. 

With  the  pilot  cost  functional  modified  as  in  Eq.  (15) ,  the  pilot  model  control 
is  now  obtained  by  minimizing  a  new  cost  functional,  the  result  being 

T„  6  +  6  *»  -Lx(t)  V.  (t)  (19) 

N  0 

But  since  the  cost  functionals  of  Eq.  (9)  and  (15)  eure  not  the  sane,  the  opti¬ 
mal  gains  L  in  Eq.  (19)  differ  from  those  in  Eq.  (13).  Hence,  the  flight 
director  signlas  of  Eq.  (14)  and  the  required  pilot  control  gains  in  Eq.  (19) 
are  no  longer  in  harmony.  This  mismatch  can  be  corrected  via  the  iterative 
process  of  computing  feedback  gains  and  flight  director  signals  as  shown  in  (1). 

'ibis  algorithm  has  given  rapid  convergence  in  the  terrain  following  problem. 

Only  four  iterations  have  been  needed,  and  the  resulting  converged  gains  were 
within  10  percent  of  the  initial  gain  values  obtained  from  Eq.  (9) . 
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lh«  num*ric«l  results  of  the  flight  director  design  process  eret 


1. 

2. 

3. 


design  parameter,  yro.max^^ 
flight  director  weighting, 
flight  director  signal 


1 


y 


S - 

FD  ,Dax 


1 

37 
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ypjj  -  Lx  -  j|3‘10“3  .13  .11  .76  ..48  -1.2  .Os]  x 

He  do  not  yet  examine,  terrain,  following. performance -with  the  flight  director 
display,  as  this  is  the  subject  of  the  display  element  level  in  wi^  all  pro-* 
posed  displays  are  con^ared. 


DISPLAY  SLEMENT  LEVEL  ANALYSIS 


Ihe  next  step  in  the  display  design  methodology  is  to  evaluate  control  per¬ 
formance  for  several  candidate  display  systems.  The  evaluation  process  begins 
with  the  definition  of  a  performance  metric  for  the  terrain  following  task. 

Often,  the  control  performance  requirements  of  the  pi lot- vehicle  combination  a: 
specified  in  terms  of  allowable  excursions  or  desired  RMS  deviations  in  system 
states.  The  design  specifications  are  generally  a  function  of  mission  require' 
ments  or  flight  conditions.  Recall  that  the  nominal  altitude  of  the  aircraft 
over  the  terrain  is  200* ,  and  that  the  maximal  FPE  deviation  "allowed"  is  40* . 

**  chosen  as  the  design  tolerance  in  the  control  performwce 

metric,  which  is  defined  as 

e 

^  max 

\'i  >f^ 

^max 

This  performance  metric  measures  the  probability  that  the  aircraft  does  not 
deviate  more  than  en^«v  -  +40'  from  the  desired  path  n(t}.  The  maximum  level 
of  control  performance  is  selected  as  Pc,maLX  * 

The  OCM  parameters  to  be  used  in  all  candidate  display  systems  are: 

observation  noise  (for  all  eventual  indicators),  Py^  *  .20  dB; 
motor  noise,  ■  -25  dB;  time-delay,  tq  ■  .15  sec. 

The  neuromuscular  tisie-conetant  has  already  been  specified  as  *  -1^ 

Using  these  parameter  values  and  the  performance  metric  P^,  Eq.  (20)  ,  we  now 
evaluate  and  compare  the  candidate  display  systems. 


exp 


e^(t) 


dte(t)] 


(20) 
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Display  System  Synthesis 

STATUS  VISPLAV 


status  display  system  consists  of  a  FPS  e(t)/e(t),  and  pitch  and  pitch  rate, 
9(t),  q(t),  indicators.  This  rudimentary  display  is  not  a  truely  synthesised 
system  at  which  this  study  is  aimed;  nevertheless,  we  use  the  status  display 
as  a  benchmark  in  the  display  system  comparison  process.  The  selection  of 
[a,  e.  Or  tot  the  status  display  set  is  naturid  (6],  and  all  subsequent 
display  systesis  Include  the  status  display  set.  Naturally,  the  status  display 
~  system  alone  shquld  yield  the  worst  terrain  follow^g  performance.  Also,  we 
assign  indifference  threshold  values,  a^  to  e(t),  e(t),  6(t),  and  q(t) , 
according  to  the  rule  16]  ai  •  |yi,maxl/®*  Following  the  usual  assua^tion  that 
rate  viuriable  thresholds  are  one  half  of  the  thresholds  on  the  corresponding 
position  variables,  we  obtain 


4  e  -  4  -40' 
8  max  8 


S  j 


2 


2. 5 '/sac  ; 


a  -  i- q_  •h  »4*/aoc  -  0.5*/sec>  a»»  2*a  -I* 

q  8  ^ax  8  ®  9 


mVlCTOR  VJSPLAV 

Grunwald  and  Merhav  have  shown  t8H91  that  acceleration  cues  are  vital  in 
visual  field  control  and  that  they  are  obtained  by  estimating  the  future  vehicle 
path.  These  findings  are  in  close  agreement  with  our  information  level  analysis, 
in  which  it  was  shown  that  the  terrain  "acceleration",  n(t) ,  demands  the  largest 
amount  of  attention  among  all  system  states.  Such  information  can  best  be 
derived  (or  estimated]  by  the  pilot  when  the  vehicle's  future  altitude  is  dis¬ 
played  relative  to  the  future  terrain-path.  We  define  T  as  the  prediction  time 
(i.e.  TaDo/Uo,  where  is  the  distance  ahead  at  which  the  prediction  is  dis¬ 
played)  ,  and  the  predictor  signal  is  then  given  by 


e  (t)  -  n(t+T)  -  h(t+T)  (21) 

P 


The  underlying  assisnption  in  the  pi^edictor  display  is 
path  is  along  the  velocity  vector  Uq.  We  rewrite  Eq. 
assumption,  viz., 

e  (t)  -  n(t+T)  -  rh(t)  +  Th(t)]  -  n(t+T)  -  h(t) 
P 


that  the  predictor  vehicle 
(21)  to  reflect  this 


■  l80^ 


Also,  the  OCM  assumes  that  the  pilot  derives  rate  information  from  the  predictor 

indicator,  e  (t) .  The  appropriate  equation  for  this  signal  is 
P 


e  (t)  -  n(t+T)  -  h(t)  -  Th(t) 
P 


-  -leo^  9<ti  *ieo?  »<'>  *  ieo=-  ‘ 


(t) 


(23) 
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Such  A  display  is  easy  to  simulate  and  implement  using  e.g.,  a  forwardlooking 
radar.  An  actual  display  that  was  used  in  the  experimental  validation  is  shown 
in  Figure  6.  It  is  important  to  indicate  that  the  projection  of  Uq  on  a  normal 
surface  located  T  seconds  flight  time  ahead  is  required  (represented  by  the 
cross  in  Figure  €. 

Equations  (22- (23)  in  their  present  form  cannot  be  modeled  directly  in  the  OCM 
steady-stats  analysis,  where  only  events  at  time  t  are  treated.  This  problem  can 
be  "solved"  by  replacing  the  signals  IKt+T)  and  n(t+T)  with  their  (optimally) 
predicted  future  values,  viz., 

n(t+T)  •  Ejn(t+T)j  n(t),  n(t),  n(t)j  i  n(t+T)  •]£  n(t+T)|  n(t)  ,iT(t)  ,ii(t)j 

(24) 

Such  an  approximation  can  be  easily  obtained  from  the  3x3  upper-left  block 
of  A  in  Eg.  (8) .  This  results  ^  estimates  which  are  a  linear  combination  of 
the  terrain  states  n(t),  ft(t),  ii(t)  (6].  Specifically  we  may  write 


n(t+T)  -  pjj(T)n(t)  +  pjj(T)n(t)  +  pjj(T)n(t) 
n(t+T)  -  rj^(T)n(t)  +  r^(T)iT(t)  +  rjJ(T)li(t) 


(25) 


where,  as  indicated,  the  p  and  r  coefficients  are  a  function  of  the  prediction 
time,  T.  Thus,  we  rewrite  Eqs.  (22) -(23)  as  a  linear  combination  of  the  system 
state: 


ep(t) 

;p(t) 


-  c  (T)x(t)  +  Dm6(t) 
P  P 
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(26) 


The  indifference  thresholds  on  the  predictor  are  assumed  identical  to  those  of 
the  FPE,  e(t)/e(t) . 


The  last  issue  which  must  be  addressed  is  the  selection  of  the  prediction  time 
T.  The  present  AlO  HUD  uses  the  value  Tsr4  sec.  This  value  has  been  selected 
for  use  in  the  present  display  analysis  and  in  the  subsequent  experiments.  It 
has  been  shown  (61 ,  however,  that  the  optimal  prediction  time  for  the  given 
control  task  and  assumed  terrain  characteristics  is  T*  ■  1.5  sec.  The  numeri¬ 
cal  values  of  Cp(T)  and  Dp(T)  of  Eq.  (26)  for  T  »  4  sec.  and  TWT^^l.S  sec.  are 
given  in  the  Appendix. 
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THREE  VJMENSJOHAL  PERSPECTIVE  TUNNEL  VISPLAV 


ld«a  of  a  displaying  3-D  perspacitva  tunnel  which  envelopes  the  trajectory 
over  the  terredn  is  not  entirely  new.  It  has  recently  been  studied  and  simula¬ 
ted  by  Grunwald  in  a  helicopter  approach  context  [10] .  Such  a  display  is  a 
cooputer-generated ,  "through-the-windshield”  perspective  view  of  a  tunnel  that 
follows  the  contours  of  the  terrain.  In  practice,  it  seems  as  if  the  tunnel 
was  flying  towards  the  observer.  Ihe  pilot,  on  his  part,  tries  to  maintain 
the  aircraft  as  close  to  the  tunnel's  center  as  possible.  Figure  7  shows  the 
txinnel  geometry  and  display  which  was  used  in  the  experimental  validation. 

Ihe  present  FPB,  ~e(t),  is  hot  ejqplicity  available  to  the  pilot  from  the  tunnel 
display.  He  can,  however,  derive  sufficient  rate  and  acceleration  information, 
as  dictated  by  the  information  level  results,  from  a  continuance  of  future 
flight  path  errors  displayed  by  the  perspective  tunnel.  It  is  necessary  now, 
to  translate  the  information  provided  by  the  tunnel  into  an  analytical  model 
for  application  of  the  OCM. 

A  plausible  approach  to  the  modeling  problem  has  been  suggested  by  Tomizuka 
[11]  in  the  so-called  "finite  preview"  problem.  If  the  tunnel  is  sufficiently 
long,  we  may  assume  an  infinite  preview  time.  The  finite  preview  problem  is 
then  reduced  to  a  common  optimal  tracking  problem,  and  can  be  treated  as  such. 

Both  approaches,  albeit  plausible,  require  major  modifications  in  the  OCM 
methodology  and,  therefore,  are  not  considered  here.  The  modeling  approach 
taken  in  the  present  study  treats  the  tunnel  display  in  the  OCM  framework.  As 
indicated,  the  tunnel  provides  a  continuance  of  future  flight  path  errors, 
assuniing  a  straight  flight  path.  Formally,  this  information  base  may  be  re¬ 
presented  as  e(t<fT),  Te[o,tp]  where,  in  general,  tp<  •  .  However,  such  a 
representation  is  impractical  from  a  modeling  point  of  view.  One  approxima¬ 
tion  is  to  replace  e(t+-T)  with  Np  "indicators"  which  represent  the  PPE  values 
at  distinct  points  in  the  future,  viz.,  e(t-H7i),  Oi  «  tpi/Np  where  i  varies 
from  1  to  Np.  The  indicators  e(t-«-a^)  would  then  be  treated  as  independent  Np 
predictor  display  systems.  Such  a  model,  although  requiring  an  extensive  sat 
of  equations,  if  Np  is  chosen  to  be  large,  can  be  implemented  in  the  OCM  frame¬ 
work.  Ihis  modeling  approach  is  carried  further  by  assuming  that  the  pilot 
concentrates  on  a  single  distance  ahead,  i.e.,  I^*l.  since  the  underlaying 
assumption  of  the  OCM  is  that  the  pilot  adopts  an  optimal  control  policy,  it 
is  equally  valid  to  assume  that,  in  the  tiinnel  display,  he  choses  the  optimal 
prediction  distance/time,  T*,  when  looking  down  the  tuinnel  path.  We,  therefore, 
replace  the  Np  e(t-fa^)  observations  with  a  single  indicator  eCt-t-T").  The 
tunnel  display  model,  <(t),  is  then  simply 


C  (T*)x(t)  +  D  (T*)6(t) 
P  P 


(27) 


%diere  the  numerical  values  of  Cp(T*)  and  Dp(T»)  T**1.5  sec.  are  given  in  the 
Appendix . 
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Oespita  initial  similarities,  there  is  a  fundamental  difference  between  a  simple 
optimal  predictor  display  where  T=T*«1.S  sec.,  and  a  tunnel  display.  Although 
both  displays  are  represented  by  the  saijie  equation  (26)  ,  the  tunnel  display  does 
not  include  the  velocity  vector's  tip,  U©  (Fig.  6)  projected  jn  the  normal  sur¬ 
face  located  T*  seconds  flight  time  ahead.  The  end  point  of  Uq  is  estimated 
rather  than  displayed  in  the  perspective  tunnel.  ^This  fact  is  reflected  in 
the  OCM  by  large  observation  thresholds  on  K(t},  K(t).  Given  the  +40'  tunnel 
dimensions,  as  implemented  in  the  subsequent  experiments,  we  assume 

•< 

These  thresholds  are  significantly  leurger  than  the  indifference  thresholds  used 
for  the  simple  predictor  display  (5  ft  and  2.5  ft/sec  respectively).  Naturally, 
such  large  thresholds  tend  to  degrade  terrain  following  performeuice.  To  over¬ 
come  this  problem  the  following  display  system,  is  suggested. 

meGRATEV  TUNNEL/VELOCny  VECTOR  VISPLAV 

In  this  system  we  simply  superimpose  the  velocity  vector's  (Uq)  trace  on  the 
existing  tunnel  display  as  shown  in  Fig.  6.  Again,  the  value  used  is  T«4  sec 
euid  not  T*,  in  accordance  with  the  current  AlO  display  system.  It  is  obvious 
that  incorporating  this  new  information  will  reduce  the  thresholds  a^/a^,  since 
^e  pilot  now  has  a  reference  poxnt  about  which  he  will  "center"  n(t+T*).  Since 
Uq  is  projected  at  T*4  sec,,  and  the  pilot's  "focus"  in  the  tunnel  is  at  T*1.5 
sec.,  the  thresholds  a^/a,^  are  not  reduced  to  the  a^/a^  values,  as  in  the  pre¬ 
dictor  display,  but  rather  to  an  intermediate  value.  We  select 

a^  -  10',  a^^  -  5 '/sec 

The  information  base  now  Includes  both  tunnel  K(t)/K(t),  and  a  4  second  pre¬ 
dictor,  ep(t)/«p(t),  (in  addition  to  the  statvus  display).  The  Sp/Sp  thresho.'.d 
values  remain  unchanged,  5',  2, S'/sec.  respectively. 


f LIGHT  VJRECTOR  SYSTEM 

The  status  information  base  is  now  augmetned  with  the  flight  director  position 
and  rate  observation  ypQ(t)  ,  yfQ(t)  as  discussed  previsouly.  The  ypo^i'FD 
observation  equations  are  given  by 

ypp(t)  -  Lx(t)  -  (3.10"3  .13  .11  .76  -.48  -1.2  .06)  x(t)  (26) 

y-utt)  “  iJc(t)  -  LA  x(t)  +  LB  6(t) 

(29) 

-  (-3.10-^  .03  .05  .91  .31  -.48  O)x(t)  +  3.26(c) 


Also,  using  the  fact  that  y  :=3,  the  indifference  thresholds  are 

FD, max 

*FD  ”  8  ‘^FD,max  "  8  '  *  2  *FD~‘^ 
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In^lementatlon  of  the  flight  director  in  a.,practical  manner,  using  future 
terrain  path  information  in  lieu  of  II  emd  n,  is  described  in  the  sequel. 

Thus,  we  have  proposed  and  obtained  analytical  models  for  five  cemdidate  dis¬ 
play  systems.  The  next  task  in  the  analysis  procedure  is  to  evaluate  control 
performance  and  attention  allocation  for  these  systems. 


Control  Performance;  Modeling  Results 

The  performance  of  each  of  the  display  systems  is  evaluated  in  terms  of 

1.  control  ^cformance,  and 

2.  acceleration  stress  levels 


Following  tl]-(6],  we  introduce  now  the  concept  of  control  and  monitoring  work¬ 
load.  The  control  workload  metric  is  based  on  the  fractional  attention  the 
pilot  allocates  among  the  various  display  indicators.  It  is  assumed  that  a 
pilot  distributes  a  total  amount  of  attention,  or  workload,  fxfts0.8<1.0 
between  the  tasks  of  control  and  monitoring,  leaving  about  20  percent  of  his 
capacity  for  other  duties  (e.g.,  communications).  Let  and  fj^  denote, 
respectively,  the  control  ^md  monitoring  attentions,  or  workloads.  'Rius. 
f^  foi  -  fx.  The  attention  allocated  for  control,  f^,  is  distributed  among 
all  of  the  display  variables  yj^,  y2,  ...,  y^jy,  where  yj^  and  ■  y^  (i  ■  odd) 

are  obtjdned  from  the  same  display  indicator.  If  fci^  ^  ^he  attention 
allocated  to  y^^  for  control  purposes  ,  then  the  constraints  on  f^^  are 


i^odd 


Cl 


-  f 


'c,i+l 


ci 


1,  3,  5, 


(30) 


The  pilot  allocates  his  attention  among  displays,  spending  the  larger  on 
displays  that  are  most  useful  for  control. 


With  selected,  the  pilot-vehicle  model  yields  predictions  of  the  perfor¬ 


mance  metric,  P^,  Eq. (20). 


Using  this  prediction,  we  can  study  the  tradeoffs 
between  fg  and  P^  for  any  given  display  system.  Figure  2  is  a  typical  per¬ 
formance/workload  curve.  It  shows  the  performance  attained  for  a  given  work¬ 
load,  as  well  as  the  workload  required  to  obtain  a  given  performance  level. 

In  Figure  2  the  intersection  of  the  line  P^.  »  Pc,max  versus  fg 

curve  gives  rhe  minimum  amount  of  control  attention  required,  fc,req> 
given  system  to  meet  Pg  specifications.  The  difference  between  this  amount  of 
attention,  and  the  total  available  for  the  entire  task  is  the  residual  work¬ 
load  available  for  monitoring 


f 


m, avail 


f 

c,req 


(31) 


The  process  of  comparing  the  cauididate  display  systems  is  now  clear.  As  an 
example,  one  may  observe  Figure  3.  Clearly  display  system  1  is  superior  to 
display  system  2,  since  less  control  workload  (or  required  control  attention) 
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Is  ^S4d6d  to  meet  tho  requlrod  performanca  level, 
available  for  monitoring  duties  when  using  display 


Moreover,  more  attention  is 
system  1. 


rigure  2.  Conceptual  Control  Performance 
Versus  Workload  Curve. 


Figure  3.  Guidelines  for  Evaluating 
Control/Display  Designs. 


In  the  terrain  following  task  we  compute  the  control  performance  metric  P  , 
Eq.  (20),  for  the  candidate  systems  given  the  constraints  fr  •  0.2,  0.4,  8.6, 
0.8  and  1.0.  Also,  the  pertinent  RMS  flight  path  errors  (e^n-)  and  g-levels 

“■«  obtained.  These  results  are  summarized  in 

Taola  2e 


TABLE  2.  PREDICTED  CONTROL  PERFOR.MANCE  (?<;), 
FPE,  (ft)  AND  g-STRESS  (g's)  RESULTS 
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Using  these  numerical  results,  the  display  systems  attain  the  rank  ordering 
as 'shown  in  Figure  4.  Using  Bq.  (31)  we  are  now  able  to  compute  the  required 
control-attention,  fc,req  (workload),  and  the  available  monitoring  attention, 
^m  avail'  each  of  the  candidate  display  systems.  We  assume  £<p«.8.  These 
results  are  summarized  in  Table  3. 


TABLE  3.  WOBKLOAD  AND  MONITORING 
ATTENTION  RESULTS 


Display 

System 

^c,req 

^m, a vail 

Status 

».8 

0 

Tunnel 

>.8 

0 

Predictor 

.64 

.16 

Tunnel  + 
Predictor 

.48 

.32 

Flight- 

Director 

<.2 

>.6 

Figure  4.  Display  System  Rank  Ordering  - 
Analytical  Results. 


It  is  evident  from  these  results  that  some  form  of  synthesized  display  must  be 
considered  in  the  AlO  aircraft,  as  the  rudimentary  status  display  yields  an 
unsatisfactory  control  performance.  It  is  also  clear  that  the  best  system,  in 
terms  of  reduced  control  workload,  available  monitoring  attention,  and  lowest 
levels  of  g-stress,  is  the  flight  director  display.  In  addition,  the  flight 
director's  Pg-versus-fc  curve  is  almost  flat  (i.e.  dPc/d£c“0)  for  fg  e(0.4,0.8], 
which  indicates  that  this  design  is  robust  with  respect  to  external  attentional 
demands  that  might  be  placed  on  the  pilot.  The  tunnel,  on  the  other  hand, 
exhibits  supprisingly  poor  results,  as  it  ranks  only  fourth,  after  the  predictor 
and  does  not  meet  the  performance  criterion. 

The  predictor  display  requires  a  very  high  control  attention, 
and  the  avail£kble  monitoring  attention,  fm, avail'  only  .16.  Although  the 

design  specifications  are  met,  such  a  display  system  may  not  be  acceptable,  as 
it  would  be  too  sensitive  to  a  possible  degradation  in  control  attention  capac¬ 
ity.  However,  the  integrated  tunnel/predictor  display  system  gives  a  satis¬ 
factory  performance.  Next  we  validate  the  modeling  results  experimentally. 

EXPERIMENTAL  VALIDATION 


A  primary  objective  of  this  study  was  the  validation  of  the  model-based  display 
design  procedure  described  previously.  The  validation  phase  consisted  of 


fixed-base  man- in- the- loop  simulations  of  the  AlO  terrain  following  scenario 
for  the  four  synthetic  displays.  The  experiments,  conducted  largely  indepen¬ 
dently  of  the  analytic  effort,  were  performed  at  the  University  of  Connecticut. 


DISPLAY  FORMAT 

A  precursor  to  the  experimental  phase  is  the  design  of  the  display  format,  i.e. 
the  details  of  the  display  panel  layout,  clearly,  this  is  largely  an  art,  but 
can  be  guided  by  the  results  of  the  display  element  analysis  with  regard  to 
threshold  values  eutd  scale  range.  Four  basic,  or  status,  displays  were  used 
in  the  experiments  in  addition  to  the  synthetic  display.  The  basic  displays 
were  the  following. 

1.  Error  Indicator.  This  showed  instantaneous  error  about 
the  nominal  terrain-following  path.  He  used  a  vertical 
scale  of  +50  ft  ramge  (recall  40  ft  is  the  maximum  design 
error) .  The  distance  between  scale  markings/divisions 
was  chosen  as  5  ft,  which  corresponds  to  a  display  thres¬ 
hold  of -2.5  ft.* 

2.  Pitch  Indicator.  A  stylized  aircraft  pitch  indicator 
was  used  to  display  6(t)/q(t).  A  maximum  range  j^lO* 
was  allowed.  Hiniitnun  scale  marking  was  2.5*. 

3.  g-Meter.  Although  vertical  acceleration  was  not  shown 
to  be  of  significance  eis  an  observation,  our  analysis 
assumed  that  PMS  g-level  entered  (subjectively)  in  the 
pilot's  cost  functional.  Since  our  simulation  was  fixed- 
base,  the  only  possible  perception  of  g-level  was  via 
visual  stimulus.  Thus,  the  subjects  were  "aware”  of 
their  commanded  accelerations. 

4.  Radar  Altimeter.  This  display  is  essentially  a  duplication 
of  the  error  information,  i.e.  the  difference  in  altimeter 
reading  from  200  ft  is  the  error.  It  is  included  for  those 
cases  where  the  error  indicator  may  be  off-scale,  |e(t)|>50'. 

In  addition,  any  realistic  display  panel  will  likely  contain 
this  information. 

Figure  5  shows  the  display  p^mel  layout  that  we  used.  The  center  screen  area 
was  set  aside  for  the  specific  synthetic  displays  to  be  investigated.  The 
display  in  the  lower  right  comer  is  associated  with  a  side  monitoring  task 


He  generally  assume  that  the  display  threshold  is  half  the  minimum  scale  mark¬ 
ing  or  0.05*  visual  arc,  whichever  is  the  larger,  'fhe  display  threshold  should 
be  less  than  the  control  indifference  threshold,  y  .„/6»  for  a  well-designed 
display. 


which  will  not  be  addressed  at  this  time.  The  entire  display  was  presented  to 
the  subject  on  a  VS60  graphics  screeni  the  total  display  size  was  14"  n  12". 


Figure  5.  Basic  Display  Panel  Layout  for  Terrain-Following  Simulation. 


the  basic  display  format  of  Figure  5  was  the  same  for  all  experiments.  Iha 
only  difference  among  the  cases  studied,  was  the  form  of  the  synthetic  display. 
These  are  now  described. 


Predictor  Display 

In  this  display, we  present  the  future  terrain  n(ttT)  and  extrapolated  aircraft 
position  h(t)-*-Th(t)  where  T>4  sec.  The  display  format  used  is  shown  in  Figure 
6.  Here  the  cross  represents  the  aircraft  flight  vector.  The  "terrain-box" 
represents  em  80' (K)  xlOO' (W)  window  centered  on  the  terrain  path  at  a  dis¬ 
tance  DQ«4xUQ=il900 '  ahead  of  the  aircraft.  Thus,  if  the  subject  kept  the  cross 
within  the  box,  the  linear  prediction  of  future  error  would  be  <40*.  For  con¬ 
venience,  the  cross  was  fixed  at  the  center  of  Che  synthetic  display  area, 
i.e.,  only  the  terrain-box  moved. 

Tunnel  Display 

The  stylized  tunnel  display  that  was  programmed  for  the  experiments  is  shown 
in  Figure  7.  The  "tunnel"  consists  of  five  "windows",  separated  in  distance 
by  500*.  Thus,  with  the  extension  lines,  the  tunnel  presents  the  future  path 
some  2500*  -  3000*  ahead  of  the  aircraft.  The  tunnel  is  centered  on  the  nominal 
terrain  path  and  has  longitudinal  dimensions  ^40'  (to*  correspond  with 
lateral  dimensions  4-so'. 
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tunnel  (windows)  are  fixed  in  inertial  space.  'Hius,  as  the  aircraft  "flies" 
forward,  the  tunnel  windows  move  towards  the  observer.  When  the  leading  window 
reaches  a  minimal  distance  of  100'  from  the  aircraft  it  disappears,  and  a  "new" 
window  appears  at  the  tunnel's  end.  This  gives  the  illusion  of  continual  for- 
ward  motion.  The  perspective  view  of  the  tunnel  is  along  the  aircraft's  flight 
vector,  Y(t),  i.e.,  the  viewing  axes  are  aircraft  centered  with  the  forward 
r-eucis  aligned  with  Y(t). 

In  the  present  experiments,  tunnel  variations  occur  only  in  the  longitudinal 
axis.  However,  the  computer  simulation  can  treat  tunnel/terrain  and  aircraft 
motion  in  both  longitudinal  and  lateral  axes.  A  complete  description  of  the 
computer  simulation  and  software  may  be  found  in  [12]. 

Integrated  Tunnel  and  Predictor  Display 

This  display  format  is  essentially  a  combination  of  the  two  previous  displays. 
Ihe  integration  has  been  effected  by  adding  £kn  additional  "window"  to  the 
tunnel  display  at  a  range  Dq»1900'  ahead  of  the  aircraft.  This  window  does  not 


Figure  6.  Predictor  Display  Symbology.  Figure  7.  Tunnel  Display  Format. 


Figure  8.  Integrated  Tunnel  and 
Predictor  Display. 


Figure  9.  Flight  Director  Display 
Symbology. 


move  towards  the  observer,  but  the  other  windows  pass  through  it.  The  display 
format  is  shown  in  Figure  8.  In  order  that  the  predictor  window  be  visually 
prominent  it  is  shown  brighter  than  the  other  elements  that  maXe  up  the  tunnel 
display. 

The  velocity,  or  flight-path  vector  is  superimposed  on  the  tunnel  as  a  cross. 
Since  the  tunnel  view  is  centered  on  this  vector,  the  cross  remains  station¬ 
ary  in  the  center  of  the  viewing  area.  Of  course,  the  tunnel  (which  is  fixed 
in  inertial  space)  curves  up  or  down  depending  on  the  terrain  and  aircraft 
motion.  We  note  that  if  the  tunnel  view  were  centered  on  the  aircraft  pitch 
angle,  then  the  velocity  vector  projection  would  per  force  be  different. 

Flight  Director  Display 

The  flight  director  signal,  derived  via  the  methodology  described 

earlier  is  given  b/ 

yj.jj(t)  -  -.oo3n(t)  +  .i277n(t)  +  .logsiict) 

+  .76a(t)  -  .476q(t)  -  1.245e(t)  +  .0594e(t)  (32) 

This  has  been  implemented  as 

ypjj(t)-Cin(t+7)-C2n(t)+. 76a (t)-.476q(t)-l. 2456 (t)+.0594e(t)  (33) 

where  ci  •  .0745,  cj  ■  .0775,  7  ■  1.715  sec.  In  deriving  Eg.  (33)  we  use  the 
approximation  IKt  +  T)  *  n(t)  +  7n(t)  ♦  (?^/2)n(t)  and  equate  coefficients  with 
Eq.  (32)  .  Note  that  c^  may  be  assumed  equal  to  C2  with  little  or  no  observed 
effects.*  In  Eq.  (33),  n(t-f?)  is  the  terrain  path  T  sec.  (or  B<>7*0o=:800  ft) 
ahead  of  the  aircraft. 

The  flight  director  display  is  presented  to  the  subject  in  the  form  of  a  com¬ 
pensatory  tracking  task,  as  shown  in  Figure  9.  The  cross  in  Figure  9  is  sta¬ 
tionary  with  respect  to  the  viewing  aurea;  the  signal  that  drives  the  box  is 
given  by  Eq.  (33).  In  order  to  distinguish  this  display  from  the  predictor 
the  box  and  cross  sizing  is  different. 


EXPERIMENTAL  DESIGN 


The  fixed-base  experiments  were  conducted  using  a  PDP  11/60  to  simulate  the 
aircraft  equations,  terrain,  and  to  update  the  displays.  The  display  was  pre¬ 
sented  on  a  VS60  graphics  screen  and  refreshed  30  x  per  second.  Pilot  input 
was  via  a  force  stick  controller.  The  specifics  of  the  simulations  are  given 
in  (6). 


This  is  convenient  as  only  the  path  different  n(t+T)  -  11  (t)  is  needed  in  the 
flight  director  signal. 


O  p  Q 


Four  subjects  for  the  experiments  were  selected  from  the  Air  Force  ROTC  student 
body  et  the  University  of  Connecticut.  The  display  conditions  were  presented 
to  them  using  a  Latin  square  ordering  to  minimise  any  transition  effects  on 
averaged  performance.  A  data  trial  lasted  130  sec./  the  last  0.06  x  2048  ■ 
122.88  sac.  of  which  was  used  as  data.  We  recorded  the  2048  sauries  of  con¬ 
trol  input  i  and  error  e  for  each  trial,  in  addition,  we  computed  and  recorded 
RNS  values  of  error,  control,  pitch  and  vertical  acceleration  for  each  run. 
Thus,  we  obtained  a  total  of  N  ■  8  x  4  >  32  trials  for  each  display  condition. 

It  should  be  noted  that  none  of  the  sxibjects  had  flight  experience)  two  had 
some  fixed-base  trainer  experience,  ihus,  it  is  quite  likely  that  the  subjects 
were  (unifoxnly)  not  expertly  trained  on  the  control  task.  However,  it  is 
quite  likely  that  the  relative  differences  in  performance  for  different  dis¬ 
plays  is  not  strongly  dependent  on  absolute  training  level  in  the  present  task. 


EXPERIMENTAL  RESULTS 


Table  4  gives  the  experimental  results  averaged  across  the  four  subjects.  The 
averages  were  computed  first  for  each  subject  and  then  across  subjects  to  ob¬ 
tain  the  grand  averages.  The  standaurd  deviations  in  the  experimental  results, 
shown  in  parentheses  in  Table  4,  are  the  averaged  intra-subject  variations  and 
not  the  inter-subject  variations.  Thus,  these  numbers  eure  indicative  to  run- 
to-run  variability  that  might  be  associated  with  a  single  ("average")  human.* 


TABLE  4.  AVERAGED  EXPERIMENTAL  RESULTS 


Case 

N 

*RMS 

(ft) 

^RMS"^ 

(g) 

1 

32 

22.0 

(3.4) 

0.44 

(0.068) 

2 

30 

25.7 

(4.5) 

0.53 

(0.078) 

3 

33 

17.8 

(2.2) 

0.44 

(0.084) 

4 

36 

6.95 

(1.9) 

0.36 

(0.054) 

The  results  tabulated  in  Table  4  are  quite  interesting  with  regard  to  the  under¬ 
lying  considerations  in  our  display  design  technique.  First  note  the  rank¬ 
ordering  of  displays  with  respect  to  ej^  performance.  Here  we  see  that  the 
tunnel  display  (case  2)  fares  worst.  The  predictor  display  (case  1)  fares 
slightly  better  than  the  tunnel  alone.  The  combined  tunnel  plus  predictor 
display  (case  3)  results  in  a  meaningful  performance  improvement  over  that  of 
(1)  or  (2).  The  flight  director  display  (case  4)  yields  significantly  better 
perfonuutce  than  any  other  display  condition  —  by  a  factor  of  2.  This  is 
highly  enco\iraglng  validation  of  our  flight  director  design/synthesis  procedure. 

The  rank-ordering  of  the  different  display  configurations  is  in  precise  agree¬ 
ment  with  the  analytical  results  of  the  display  design  methodology.  While  the 


If  intersubject  variability  was  included  i.^  the  stjmdard  deviations,  the 
values  would  increase  by  20-100%. 
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abs.oluf  levels  of  control  performance  between  experiment  and  model  disagree 
slightly,  relative  performance  levels  agree  wall.  This  is  demonstrated  by  com¬ 
paring  model  predictions  (at  a  fixed  fc=^6}  for  cases  1-3  with  the  experimental 
results.  The  experimental  results  for  cases  1-3  are  consistently  higher 

than  the  model  predictions.  An  explanation  for  this  fact  is  that  the  OCM  asst'jnes 
a  well-trained  subject,  whereas  the  actual  subjects  --  not  being  pilots  --  were 
not  fully  trained  with  respect  to  the  AlO  dynamics.  While  it  is  possible  to 
model  this  effect  a  posteriori  in  the  OCM  by  increasing  observation/motor  noise 
and/or  T)),  this  was  not  an  objective  of  our  efforts.  On  the  other  hatnd,  the 
absolute  performance  levels  for  model  amd  data  in  case  4  are  in  close  agreement. 
The  reason  for  this  is  that  the  "system”  dynamics  as  perceived  by  the  subject 
eure  similar  to  K/s.  These  dynamics  are  trivial  to  learn,  so  that  training 
effects  (after  but  a  few  trials)  are  inconsequential. 

CONCLUSIONS 

An  analytic,  pilot  model-based,  display  design  methodology  has  been  applied  to 
study  workload  and  performance  trade-offs  in  a  high-speed,  terrain-following 
task.  The  methodology  combines  pilot  limitations ,  aircraft  dynamics  and  per¬ 
formance  requirements  in  order  to  determine  the  requisite  information  that 
must  be  supplied  to  the  pilot. 

Man -in- the -loop  experiments  that  evaluated  the  performance  of  the  four  candi¬ 
date  display  systems  were  conducted  at  the  University  of  Connecticut.  The 
objective  of  these  experiments  was  to  validate  the  overall  display  design  pro¬ 
cedure,  including  the  flight  director  design  synthesis  process.  Two  positive 
conclusions  resulted  from  this  effort. 

VALIDATION  OF  DISPLAY  SYSTEM  PERFORMANCE 


The  fixed-base  experiments  involved  a  terrain-following  control  task.  (A  second¬ 
ary  monitoring  task  was  also  included  but  is  discussed  elsewhere  [6].) 

The  experimental  relative  rank-ordering  of  the  four  display  systems ,  based  on 
control  performance,  was  identical  to  that  predicted  analytically  at  the  dis¬ 
play  element  level.  It  suggests  that  a  large  number  of  potential  display  (or 
control  augmentation)  systems  can  be  evaluated  analytically  at  low  expense, 
and  then  the  most  promising  options  can  serve  as  the  candidates  for  subsequent 
manned  simulation.  The  time  and  cost  savings  of  a  model-based  "front-end"  to 
the  complete  design  process  can  be  substantial. 

The  spread  in  absolute  levels  of  performance  between  the  first  three  display 
systems  and  the  flight  director  display  was  found  to  be  much  greater  in  the 
experiments  than  in  the  model  predictions.  Our  explanation  of  this  result  is 
that  the  model  assumes  a  well-trained  pilot,  whereas  the  subjects  were  not 
well-trained  on  AlO  dynamics  and  so  their  performance  was  not  at  the  model- 
predicted  levels.  On  the  other  hand,  the  flight  director  essentially  normal¬ 
izes  out  the  aircraft  dynamics,  rendering  the  control  task  much  simpler  and 
requiring  virtually  no  learning.  Here  model  and  data  absolute  performance 
levels  were  commensurate. 
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VALIDATION  OF  FLIGHT  DIRECTOR  DESIGN  PROCEDURE 


The  walytlc  technique  for  flight  director  synthesis  is  included  in  the  display 
methodology  at  the  information  level.  Here,  we  optimally  synthesize  or  aggre¬ 
gate  the  information  states  into  a  single  information  variedjle  that  could  be 
displayed  to  the  pilot.  The  flight  director  signal  is  designed  to  relate  to 
the  pilot  task  objectives,  i.e.  to  minimize  his  workload  emd/or  improve  his 
control  performance,  and  to  satisfy  the  pilot's  desired  goal  of  behaving 
approximately  as  a  gain  and  time-delay.  The  man-in-the-loop  simulations  vali¬ 
dated  the  superiority  of  the  flight  director  display  (over  all  others  considered) 
with  respect  to  control  performance.  The  ability  to  analytically  design  a 
flight  director  that  is  in  harmony  with  pilot  control  and  information  processing 
limitations  is  a  major  feature  of  the  methodology.  In  many  situations  flight 
directors  are  "designed"  via  extensive  simulations  and  tuning  using  a  pilot  in- 
the-loop.  The  analytic  design,  when  used  as  prescribed,  can  shorten  this 
experimental  procedure  to  a  great  extent. 
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ABSTRACT 


'^^^he  paper  provides  a  report  of  work-in-progress  examining  the  potential  effects  of 
introducing  increased  levels  of  automation  in  command  and  control  environments  for 
NASA's  near-earth  satellites.  To  date,  the  work  has  examined  the  implications  of 
automation  and  concluded  that  there  are  times  when  costs  outweigh  benefits,  thus 
suggesting  that  automation  not  be  introduced  into  a  system.  Assuming  that  some  level  of 
automation  is  introduced,  the  roles  of  the  human  operator  in  automated  systems  is 
explored.  Further  research  on  information  displays  designed  to  support  the  roles  of  the 
human  in  automated  systems  is  described. 

INTRODUCTION 


NASA-Goddard  Space  Flight  Center  in  Oreenbelt,  Maryland  provides  ground 
support  and  direct  control  for  all  of  NASA's  near-earth  satellites.  The  Greenbelt  facility 
has  extensive  control  rooms  which  permit  real  time,  near  real  time,  and  time  delayed 
control  of  the  various  components  on  board  near-earth  satellites.  With  the  support  of  a 
world  wide  network  of  ground  tracking  stations,  the  mission  controllers  in  Greenbelt 
establish  contact  with  each  satellite  several  times  a  day}  each  satellite  contact  lasts 
approximately  twenty  to  thirty  minutes. 

Traditionally,  each  NASA  mission  had  its  own  dedicated  mission  operations  room, 
i.e.,  a  dedicated  control  room,  with  its  own  set  of  computers,  computer  operators,  and 
data  eontroEers  to  support  the  mission.  Support  personnel  ensure  that  telemetry  data 
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and  health  and  aafety  data  are  accurately  received  from  the  spacecraft  and  that 
commanding  data  is  accurately  uplinked  and  loaded  into  the  spacecraft  memory. 

In  the  mid^seventies,  NASA- Goddard  began  to  integrate  some  of  these  dedicated 
facilities.  The  primary  motivation  was  clearly  cost.  Dedicated  computers  and  personnel 
were  often  underutilized  and  thus  very  costly.  The  Multisatellite  Operations  Control 
Center  (MSOCC)  was  designed  to  reduce  redundant  services  and  personnel  by  centralizing 
computer  facQities  and  support  personnel.  By  requiring  some  degree  of  standardization 
of  software  and  operating  procedures,  individual  satellite  missions  were  modularized,  so 
that  they  could  be  easily  "plugged"  into  MSOCC  for  the  life  of  the  mission  and  detached 
at  missions's  end.  MSOCC  is  a  support  facility  which  provides  such  services  as  scheduling 
and  allocation  of  data  processing  resources,  coordination  and  configuration  of  system 
hardware,  compute  operations,  and  data  analysis.  At  this  point  in  time,  MSOCC  is  a 
labor  intensive  operation  with  approximately  ten  people  per  shift,  three  shifts  a  day, 
seven  days  a  week.  These  personnel  are  in  addition  to  the  mission-speeific  spacecraft 
controllers  who  also  provide  twenty-four  hour  coverage,  seven  days  a  week. 

Because  of  its  labor-intensive  characteristics  and  comparatively  obsolete  hardware, 
MSOCC  was  a  natural  application  for  the  NASA-Ooddard  automation  program. 
Currently,  substantial  portions  of  MSOCC's  hardware  is  configured  manually,  mission- 
specific  software  and  data  are  stored  on  t^es  or  disks  which  require  manual  mounting 
and  dismounting  for  each  spacecraft  contact,  and  all  communication  and  scheduling  is 
done  manually. 

A  great  deal  of  effort  has  gone  into  tiie  planning  for  the  next  two  generations  of 
MSOCC  (see,  for  example,  Multisatellite  Operations  Control  Center-1  (M80CC-1)  S-year 
Transition  Plant  Automated  MSOCC-1  Data  Operations  Control  System  Study  Task 
Summary  Reporti  Operational  Requirements  Study  for  Automated  MSOCC  Data 
Operations  Control  System).  The  first  generation  is  to  be  a  semi-automated  facility  and 
the  second  fully  automated.  A  sophisticated  and  innova.ive  local  area  network  will  link 
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banks  of  micro,  mini,  and  large-scale  computers,  allowing  automated  schedule-driven 
allocati<m  and  configuration  of  hardwarei  the  system  will  be  designed  to  be  self-checking 
and  capable  of  automatically  reconfiguring  appropriate  hardware  in  cases  of  transmission 
failure  or  degraded  conditions.  Operating  under  typical  conditions,  the  system  is 
designed  to  function  fairly  autonomously  requiring  little  human  interference  beyond  the 
schedule  which  is  developed  off-line. 

NASA,  however,  has  a  very  conservative  attitude  (Sagan  et  al.,  1980)  and  both 
management  and  mission-specific  personnel  require  that  the  MSOCC  facility  be  staffed 
sufficiently  to  permit  continued  operations  even  in  the  event  of  severe  failure  of  the 
automated  system. 

In  this  respect,  NASA's  experience  in  consistent  with  that  of  many  other  automated 
control  settings.  The  result  of  increased  automation  in  th  control  room  and  in  other 
previously  manual  processes  does  not  imply  that  the  human  operator  is  being  replaced  but 
rather  that  his/her  role  is  changing  from  that  of  a  direct  controller  to  that  of  a  system 
supervisor  who  monitors  and  directs  the  computers  which  carry  out  the  moment  to 
moment  control  functions  (Rouse,  1981}  Sheridan  and  Johannsen,  1976).  In  several 
MSOCC  studies  which  outline  staffing  requirements,  for  example,  the  absolute  number  of 
personnel  is  increased. 

The  planned  automation  of  the  MSOCC  facility,  however,  has  raised  a  series  of 
human  factors  issues  about  the  position  and  function  of  the  human  operator  in  this  highly 
automated  environment.  Some  of  the  proposed  functions  and  roles  for  the  human  seem 
less  than  desirable  and  fail  to  fully  exploit  the  capabilities  of  the  human-machine 
interface. 
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DESIGN  ISSUES  IN  EMERGING  AUTOMATION 

There  are  a  numbo*  of  critical  design  issues  for  systems  which  will  include  some 
degree  of  automation.  Fundamentally,  the  question  of  whether  to  automate  at  all  must 
be  addressed;  subsequently,  if  the  decision  to  automate  some  or  all  of  an  existing  system 
is  made,  the  system  design  must  carefully  examine  the  human-machine  interface, 
ensuring  an  appropriate  allocation  of  tasks  between  the  human  and  computer  as  well  as 
devising  appropriate  mechanisms  to  allow  an  efficient  and  effective  human-computer 
dialogue. 

Whether  to  Automate 

The  decision  about  whether  or  not  to  automate  all  or  a  portion  of  a  a  control  task  is 
important.  Reasons  for  increased  automation  of  control  rooms  abound.  Rouse  (1981) 
suggests  a  number.  Fundamentally,  there  is  a  desire  for  improved  performance.  By 
automating  a  system,  it  is  hoped  that  the  system  will  support  a  higher  workload  (e.g.,  an 
airport  will  support  more  aircraft  with  automated  air  traffic  control  equipment;  MSOCC 
will  support  an  increased  number  of  satellites;  a  data  processing  facility  will  support 
more  volume  or  a  wider  variety  of  applications  tasks).  This  is  closely  linked  to  economic 
considerations.  Replacing  humans  or  augmenting  human  capability  with  computer 
assistance  may  allow  system  efficiency  to  increase  with  the  same  staff  or  decrease 
system  cost  by  decreasing  personneL  Safety  and  human  dignity  also  motivate  the 
increasing  use  of  automation.  Computers  replace  hunian  operators  in  tedious, 
unpleasant,  and  hazardous  tasks  (e.g.,  file  maintenance  and  ot.  er  clerical  tasks,  welding, 
exploration  of  deep  space).  Computers  provide  warning  and  alarm  systems  which  build  a 
higher  degree  of  safety  into  the  system  than  was  previously  available.  There  are  also 
some  things  which  computers  do  better  then  humans  and  the  shift  of  such  tasks  to  a 
computer  system  will  also  increase  system  safety  and  efficiency. 


Finally,  it  must  be  admitted  that  sometimes  automation  is  introduced  into  a  system 
simply  because  it's  there.  The  hardware  for  automation  has  advanced  much  more  rapidly 
than  design  principles  to  guide  its  implementation  (Mitchell,  1980).  It  is  often  unclear 
when  or  if  to  implement  some  facet  of  automation.  Sometimes  automation  is  introduced 
for  the  rather  fuzzy  and  certainly  indefensible  reason  that  it  will  make  the  system 
modem  or  "state  of  the  art". 

It  is  this  latter  reason  that  is  a  cause  of  concern  in  many  systems.  Automation, 
like  most  other  things,  has  positive  and  negative  attributes.  Before  its  introduction, 
dc«gners  should  be  explicit  and  detailed  about  precisely  what  advantages  an  automated 
system  will  yield.  To  the  extent  possible,  these  should  be  quantitative  measures  of 
system  performance  against  which  the  final  system  can  be  evaluated.  In  addition,  the 
potential  problems  of  automation  must  be  squarely  faced,  evaluated  in  terms  of  the 
benefits,  and  minimized  to  the  extent  possible,  by  good  design. 

NASA-Ames  hosted  an  interesting  workshop  entitled  "Human  Factors  of  Flight- 
Deck  Automation-NASA/Industry  Workshop"  (Boehm-Davis,  et  al.,  1981).  The  question  of 
whether  or  not  to  automate  particular  functions  was  critically  addressed  by  a 
distinguished  panel  of  participants,  representing  the  Man-Vehicle  System  Research 
Division  of  NASA-Ames,  the  Federal  Aviation  Administration,  the  U.K.  Royal  Air  Force, 
airline  companies,  aircraft  manufacturers,  universities,  and  consulting  firms.  The 
participants  generally  agreed  that  technology  is  now  sufficiently  advanced  so  that  it  is 
theoretically  possible  to  automate  most  systems  and,  that  though  automation  has  many 
benefits,  it  also  has  some  serious  drawbacks.  These  issues,  though  discussed  in  the 
context  of  flight  deck  automation  are  relevant  to  a  wide  variety  of  systems. 

The  two  issues  most  relevant  to  MSOCC  automation  addressed  the  effect  of 
automation  on  the  human  operator.  The  first  pointed  out  that  while  an  automated 
system  is  functioning  properly,  the  human  operator  is  reduced  to  a  system  monitor;  this 
role  may  leave  the  human,  particularly  a  highly  skilled  operator,  bored  and/or 
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complacent.  The  second  issue  is  a  direct  corollary.  Personnel  in  automated  systems  are 
often  expected  to  function  in  two  roles:  as  a  system  supervisor  when  the  system  is 
functioning  automatically  and  as  a  direct  or  manual  controller  for  emergency  or 
degraded  conditions.  The  workshop  participants  felt  that  these  two  roles  are  not 
necessarily  compatible  or  complementary;  the  roles  may  require  two  very  different  sets 
of  skills,  two  types  of  knowledge  of  the  system,  making  it  difficult  to  transition  between 
roles  and  to  adequately  perform  the  tasks  requirad  by  each  role.  ~ 

Such  issues  are  rarely  discussed  in  the  context  of  automation  yet  they  are  critical. 
Assuming  that  a  system's  reliability  depends  on  its  weakest  component,  it  is  vital  to 
ensure  that  the  human  component  and  the  human-machine  interface  is  as  reliable  as 
possible.  As  a  result,  in  evaluating  the  costs  and  benefits  of  proposed  automation,  the 
impact  on  the  human  component  and  the  human-machine  interface  must  be  clearly  and 
thoroughly  addressed.  Many  times  automation-induced  problems  may  not  outweigh  the 
benefits  of  automation  and  to  automate  may  be  the  most  reasonable  decision;  however, 
the  decision  to  automate  does  not  abrogate  the  issues,  it  merely  shifts  the  burden  to  the 
system  designers  who  must  eliminate  or  ameliorate  the  adverse  effects. 

Design  Issues  for  the  Human-Machine  Interface 

Assuming  that  decision  has  been  made  to  automate  some  or  all  of  an  existing 
system,  the  design  issues  which  affect  the  human  interface  can  be  grouped  into  three 
categories:  the  definition  of  reasonable  and  meaningful  roles  for  the  human  operator, 
allocation  of  tasks  between  computer  and  human  system  components,  and  the  creation  of 
interfaces  which  facilitate  the  human-computer  dialogue. 

The  first  two  areas  are  highly  related  and  are  likely  to  be  addressed  simultaneously 
in  the  design  process.  Creating  a  meaningful  and  reasonable  role  for  the  human  operator 
is  a  result  of  taking  a  particular  perspective  at  some  point  in  the  design  process.  The 
perspective  is  an  operatoi^entered  view  of  the  total  system  aimed  at  trying  to 


understand  the  set  of  responsibilities  assigned  to  the  operator  and  the  dynamics  of 
his/her  interaction  with  the  system.  One  useful  tool  for  gaining  this  type  of  perspective 
is  to  conduct  a  task  analysis  which  carefully  analyses  the  human  operator's  sequence  of 
tasks;  a  task  analysis  includes  identification  of  the  individual  tasks,  the  pace  of  the 
operations,  and  underutilized  operator  resources. 

The  traditional  design  approach  is  often  system-centered  with  the  result  that 
though  the  overall  s^tem,  at  least  theoretic^y,  functions  adequately  the  tasks  assigned 
to  the  operator  are  those  which  are  left  over”  or  unable  to  be  automated  -  the  human 
operator  has  traditionally  functioned  as  the  flexible  component  in  the  control  loop.  It 
often  happens  that  no  one  closely  examines  the  overall  operator  role  which  the  set  of  left 
over  tasks  implicitly  defines. 

The  problems  of  adequate  allocation  of  responsibility  between  the  human  and 
computtf  and  of  defining  a  reasonable  role  for  the  human  are  particularly  problematic  in 
the  proposed  automation  for  NASA-Goddarcfs  MSOCC  system  (Mitchell,  1981).  The 
proposed  configuration  for  an  automated  MSOCC  is  an  exciting  use  of  technology  and 
will  drastically  reduce  the  amount  of  direct  manual  intervention  in  the  DOC  (Data 
Operations  Control)  and  computer  operations  areas.  The  staffing  plan,  however,  calls  for 
maintaining  or  possibly  increasing  the  current  staff.  It  is  unclear,  however,  what  the 
eight  to  ten  people  per  shift  will  do  as  the  majority  of  their  current  functions  will  be 
automated.  Currently,  computer  operators  transport,  mount,  and  dismount  mission- 
specific  software  resident  on  disks  and  tapes.  Under  the  proposed  automation  plan,  this 
activity  will  be  fully  automated.  The  responsibilities  of  the  DOC  operator  are  also 
unclear.  Figure  1  depicts  a  scenario  which  was  given  in  an  MSOCC-1  Operations 
Requirements  Study  (FM-81-6098).  The  scenario  represents  the  anticipated  human- 
computer  dialogue  during  the  preparation  for  a  satellite  contact.  Examination  of  the 
scenario  reveals  that  the  only  active  human  input  is  to  type  the  word  "GO”  as  the  second 
to  last  step  in  the  sequence.  An  alternative  version  of  this  scenario  even  eliminates  this 
step,  assigning  the  operator  to  a  completely  passive,  monitoring  role. 
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Analysis  of  this  situation  from  an  operator^eenterad  perspective,  raises  a  number 
of  questions  about  the  reasonableness  of  the  role  assigned  to  the  human.  It  is  now  true 
that  the  MSOCC  personnel  feel,  and  in  actuality  are,  underutilized.  Because  of  the 
nature  of  their  responsibilities,  personnel  are  generally  well-trained  and  skilled,  yet  they 
are  used  at  this  point  in  time  for  relatively  insignificant  tasks.  With  the  introduction  of 
automation,  their  tasks  are  likely  to  be  further  reduced,  and  under  the  current  plan,  not 
augmented  by  any  additional  responsibilities. 

The  MSOCC-1  scenario  raises  a  number  of  issues  about  the  place  of  the  human 
operator  in  an  automated  system.  Often,  there  is  a  tendency  to  retain  the  operator  as 
the  final  redundancy  in  the  control  loop,  to  ensure  fail-safe  conditions.  Sometimes  this  Is 
indicative  of  an  underlying  distrust  of  automation  -  a  questionable  premise  in  a  highly 
automated  environment.  The  consequences  of  the  misgivings  can  be  severe.  The  first- 
order  impact  is  cost.  Labor  costs  constitute  a  large  percentage  of  a  system's  operating 
budget.  Building  a  human  backup  for  every  system  may  be  a  costly  proposition,  not 
offset  by  benefits  received. 

A  second-order  impact  directly  addresses  the  anticipated  benefits.  In  many 
automated  systems,  the  tasks  allocated  to  the  operator  approach  the  trivial,  yet  the 
operator  responsibOities  are  increased  -  he/she  is  responsible  for  the  management  and 
control  of  a  very  complex  system.  In  the  MSOCC-l  example,  the  operator  performs  a 
perfunctory  task,  and  rarely  interacts  with  the  system  in  a  meaningful  way.  Yet  in  an 
emergency,  the  operator  is  expected  to  detect  and  diagnosis  the  problem,  revert  to 
manual  control  in  order  to  re-establish  equilibrium,  and  it  is  questionable  whether,  in  this 
ease,  he/she  will  have  the  capability  should  the  need  arise. 

The  question  then  arises  what  should  the  human  do  in  an  automated  system  -  how 
should  tasks  be  allocated  to  optimally  use  both  the  system’s  human  and  computer 
resources.  The  answer  is  neither  perfunctory  nor  simple.  Essentially,  the  role  of  the 
human  component  must  be  redefined  to  include  a  cross-section  of  meaningful  tasks  which 


enable  the  human  to  function  as  responsible  and  important  component  of  the  system. 
This  redefinition  may  require  the  rethinking  of  the  overall  system  design,  reallocation  of 
tasks,  and  the  expansion  of  the  human's  responsibilities.  Task  allocation  re^res 
evaluation  of  the  strengths  and  weaknesses  of  human  and  computer  0^  . 

(Crawford  et  al.,  1977).  In  order  to  oisure  a  reasonablr  role  for  the  humaiif'  mgpwii# 
tasks  which  are  done  relatively  equally  wall  by  both  human  and  computerr  *  » 
asdgned  to  the  human.  One  interesting  possibility  receiving  some  attention^ 
rathtf  than  static,  task  allocation  scheme  wherein  tasks  are  allocated  bei  ' 
human  and  computer  by  determining  who  has  the  most  avaQable  resources  at  the  time 
that  the  need  for  the  task  arises  (Rouse,  1981). 

In  MSOCC,  there  is  some  thought  given  to  expanding  the  controller's  responsibility 
to  include  software  development/maintenance  as  well  as  the  supervisory  and  occasional 
manual  control  activities.  Augmenting  the  role  definition  in  this  way  is  a  novel  approach 
but  may  be  a  satisfactory  solution  to  the  problem  of  assigning  skilled  personnel  to 
important  but  tedious  supervisory  tasks. 

Interfaces  for  the  Human-Computer  Dialogue 

In  addition  to  defining  a  reasonable  role  for  the  human  component,  the  design 
process  in  automated  systems  must  address  the  (X'oblem  of  providing  interfaces  between 
the  human  and  computer  which  facilitates  the  human's  ability  to  interact  with  the  system 
in  a  rapid  and  effective  manner,  with  as  little  effort  as  possible. 

One  problem  that  the  dual  role  of  the  human  in  automated  systems  creates  is  that 
the  human  now  has  two  different  and  perhaps  quite  disparate  functions,  potentially 
requiring  two  different  sets  of  skills  and  two  different  views  of  the  system.  In  automatic 
mode,  the  human  needs  a  high  level,  integrated  overview  of  the  system;  whereas  in 
manual  mode  the  humsn  needs  to  have  an  understanding  of  the  system  which  is  detailed 
and  thorough  and  "nitty-gritty". 
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One  of  the  difficulties  of  the  multiple  functions  of  the  human  in  complex  systems  is 
that  the  varying  sets  of  responsibilities  suggest  that  the  operator  needs  to  build  up 
multiple  intennal  models  of  the  system  in  order  to  integrate  his  knowledge  of  the  system 
and  to  guide  his  control  actions.  A  skilled  operator  in  a  highly  automated  system  must 
build  t9  a  hierarchy  of  internal  models  which  encompass  a  set  of  system  views  which 
vary  from  a  very  general  and  broad  system  overview  to  a  variety  of  very  specific  and 
detailed  models  of  particular  subsystems.  Experimental  and  theoretical  research 
suggests  that  human  understanding  of  a  complex  system  is  guided  by  an  internal  or 
"mental"  model  of  the  system  built  up  by  the  operator  over  time.  The  adequacy  of  the 
internal  model  will  govern  the  timeliness  and  appropriateness  of  an  operator's  responses. 

One  way  to  facilitate  the  development  of  appropriate  internal  models  is  through 
information  displays  which  assist  in  organizing  information,  presenting  it  in  modes  which 
facilitate  assimilation  and  integration,  thereby  reducing  the  cognitive  load  on  the  human 
operator. 

In  traditional,  hardwired  dedicated  displays,  there  was  little  choice  about 
information  display  design.  Each  hardware  device,  data  channel  or  sensor  generated  a 
data  item  which  was  individually  displayed  to  the  operator  (e.g.,  the  battery,  the  voltage 
regulator).  Control  room  designers  could  choose  how  to  display  the  data  (dials,  bar 
graphs,  needles,  etc.)  and  could  arrange  the  set  of  displays  on  control  panels  but  had  no 
opportunity  to  selectively  display  data,  to  group  or  aggregate  it  into  higher  level 
summaries.  In  essence,  the  displays,  due  to  limitations  of  technology,  were  directly  tied 
to  the  lowest  level  hardware  subsystems  (Figure  2).  Traditional  displays  placed  a 
tremendous  burden  on  the  human  operator.  The  human  was  responsible  for  monitoring, 
sometimes  vast  amounts  of,  displayed  data,  selecting  out  relevant  items,  combining  and 
integrating  the  low  level  data  into  meaningful  forms  compatible  with  his  higher  level 
information  needs. 


The  advent  of  computer-based  displays  ^minated  the  need  for  this  type  of  display 
but  not  necessarily  the  practice.  Computer-based  displays  allow  data  to  be  filtered, 
summarised,  or  aggregated,  and  displayed  in  forms  only  limited  by  the  imagination  of  the 
designer.  Unfortunately,  perhaps  because  it  is  easier,  many  computer-based  displays 
sim^y  use  the  CRT  as  a  new  medium  on  which  to  display  "the  same  old  data  in  the  same 
old  mode"  (see  for  example.  Figure  3).  As  early  as  1975,  Braid  warned  "...there  is  an 
alarming  tendency  ...  to  propose  replacement  of  the  dedicated  conventional  instruments 
by  a  few  dedicated  electronic  displays  .  .  .  Such  proposals  ignore  the  flexibility  that 
electronic  displays  offer." 

This  is  particularly  a  problem  with  MSOCC  in  which  multiple  display  pages  are  used 
to  display  great  amounts  of  low  level,  hardware  specific  data  (see  for  example.  Figure 
3).  The  controller  must  monitor  these  displays,  abstract  out  relevant  data,  integrate  it 
into  forms  necessary  for  his  high  level  decisi<m  making.  The  current  displays  are  very 
detailed,  and  completely  lack  any  decision  aiding  features. 

In  an  automated  MSOCC  environment,  sudi  displays  would  be  even  more 
inappropriate;  the  low  level  items  would  require  a  good  deal  of  human  information 
processing  resources  to  integrate  them  into  forms  needed  to  support  the  supervisory 
control  activities  of  the  human  operator.  Hie  human-computer  dialogue  issues  for 
MSOCC  and  other  automated  systems  are  really  ones  of  design:  how  do  you  use  the 
flexibility  of  the  computer  to  best  create  information  displays  and  control.  One  strategy 
is  to  use  the  flexibility  to  present  information  in  forms  which  are  compatible  with  the 
user's  mental  model  of  the  system  and  current  role.  In  highly  automated  systems, 
assuming  that  the  operator  has  at  least  two  sets  of  internal  models:  one  which  allows 
him/her  to  function  as  a  monitor  and  system  supervisor,  and  a  second  which  allows 
him/her  to  function  as  a  manual  controller,  a  reasonable  suggestion  is  that  perhaps,  at 
the  very  least,  the  control  room  of  an  automated  system  ought  to  have  two  sets  of 
displays  which  the  operator  can  choose  between:  one  set  giving  a  high  level  system 
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overview)  the  other,  detailed  views  of  individual  subsystems.  When  acting  in  a 
supervisory  capacity,  the  high  level,  overview  displays  would  be  used.  If  more  detail  is 
desired,  if  some  problems  are  suspected,  lower  level,  detailed  displays  may  be  accessed. 

Comput«»b«sed  informaticm  displays  whi<^  explicitly  support  the  dual  roles  of  a 
human  in  an  automated  system  by  presenting  hierarchically  organized  information  will  be 
evaluated  in  the  MSOCC  control  environment.  At  this  time,  no  sample  MSOCC  displays 
are  available.  However,  in  order  to  illustrate  some  of  the  concepts  which  will  be  used  to 
design  the  MSOCC  displays,  an  experiment  with  displays  designed  using  these  principles 
will  be  described  in  the  next  section.  The  system  and  displays  were  developed  at  The 
Ohio  State  University  (Mitchell,  1980). 


PROTOTYPE  HIERARCHIC  DISPLAYS 

The  laboratory  system  simulated  a  conveyor  system  in  which  engines  were  routed  in 
and  out  of  various  check  points.  Depicted  in  Figure  4,  the  system  had  engines  arriving  at 
Station  1,  the  diamond  labelled  **1",  which  the  controller  either  routed  into  Buffer 
Storage  or  on  to  Station  2.  Once  at  Station  2,  the  engine  needed  to  go  to  the  Test 
Station,  Station  6,  passing  through  Stations  3  or  4.  Once  tested,  an  engine  either  was 
routed  out  the  system  throught  Station  3  or  into  the  Repair  Station,  depending  on  the 
outcome  of  the  test.  The  system  was  highly  constrained,  allowing  no  more  than  one 
engine  at  a  station  or  on  a  conveyor  belt  at  any  given  time. 

Figure  5  contains  an  information  display  for  this  system.  This  display  might 
correspond  to  a  traditional  hardwired  display,  or  to  a  fairly  {u^imitive  CRT  display  in 
which  there  was  no  attempt  to  exploit  the  capabilities  of  the  computer-driven  display. 

In  trying  to  create  displays  that  were  more  attuned  to  the  human's  information 
needs,  a  discrete  control  modelling  methodology  was  used  to  structure  information  needs 
by  control  functions  (Miller,  1979).  Individual  control  activities  were  grouped  together 
into  meaningful  control  functions  with  a  strategy  that  might  be  similar  to  the  way  in 
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which  t  controller  thinks  about  them.  Next»  information  needed  to  evaluate  the 
feasibility  of  actions  for  particular  control  functions  was  identified,  examined  and 
structured. 

An  example  may  help  to  illustrate  the  point.  Entry  control  is  a  vital  control 
function  in  the  system.  It  concerns  routing  engines  from  the  Buffer  portion  of  the 
system  to  the  Test'Repair  loop.  Poor  entry  control  strategy  will  result  in  poor  overall 
system  performance.  The  fundamental  entry  control  decision  is  whether  or  not  to 
release  an  engine  waiting  at  Station  2  into  the  Test-Repair  loop.  Given  the  system 
ctmstraints,  in  order  to  release  an  engine,  a  number  of  conditions  must  be  met:  an  engine 
must  be  waiting  on  Station  2,  Stations  3  and  4  must  both  be  clear,  and  both  the  Test- 
Repair  Feed  and  Test-Repair  Exit  conveyors  must  be  clear.  There  is  a  natural  structure 
and  hierarchy  to  these  conditions  which  is  represented  in  Figure  6.  The  presence  or 
absence  of  an  engine  at  Station  2  is  of  primary  importance.  One  can  not  route  an  engine 
which  is  not  there.  Given  the  presence  of  an  engine  at  the  Station,  the  states  of  the 
other  related  system  components  must  be  examined.  The  rules  of  the  system  constrain 
the  operator  so  that  an  engine  may  be  released  from  Station  2  only  if  each  of  the  other 
four  components  are  in  a  clear  or  idle  state.  Thus,  at  one  level,  all  the  controller  is 
concerned  about  is  whether  or  not  these  four  components  are  in  the  required 
configuration.  This  suggests  that  a  higher  level  information  system  might  be 
appropriate,  one  that  summarizes  the  respective  statuses  of  these  components  and 
presents  it  in  a  form  compatible  with  the  human's  model  of  the  system.  Figure  7  depicts 
this  situation  by  means  of  the  Test-Repair  Feed  System.  This  system  is  in  fact  not  a 
system  component  at  all  -  it  is  a  pseudo-component,  an  artifact  developed  to  enhance  the 
human-computer  dialogue.  This  system  is  in  the  avaQable  state  only  when  the  four  real 
system  components  it  summarizes  are  in  the  appropriate  states  for  a  entry  control 
action,  i.e.,  all  available,  otherwise  the  Test-Repair  Feed  System  is  unavailable. 
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Figures  8  end  9  depict  displayed  information  in  response  to  an  operator’s  request 
for  entry  control  information.  Figure  8  gives  the  status  of  Station  2  but  indicates  that 
the  Test'Repair  Feed  System  is  not  in  an  appropriate  state  for  entry  control  activity. 

Figure  9  illustrates  another  aspect  of  the  information  display  system.  In  this  case, 
there  is  no  engine  at  Station  2,  thus,  regardless  of  the  state  of  the  other  system 
components,  an  entry  control  action  can  not  be  undertaken.  As  a  result,  the  state  of 
Station  2  is  all  the  information  that  is  displayed.  The  empty  status  of  Station  2  is  a 
sufficient  condition  tof  terminating  further  consideration  of  a  control  action  at  that 
point.  This  type  of  selective  display  of  information  is  an  attempt  to  match  the 
processing  strategy  of  an  operator  and  to  reduce  cognitive  load  by  dynamically  limiting 
and  filtering  displayed  information.  If  the  controller  desired  to  see  the  more  detailed 
status  of  the  individual  system  components,  he  could  summon  that  information  (Figure 
10).  This  figure  depicts  the  status  of  all  the  system  components  potentially  affecting  an 
entry  control  decision. 

As  a  third  option  the  controller  could  request  to  see  all  the  information, 
unorganized  and  unfiltered.  This  display  is  given  in  Figure  S.  It  is  interesting  to  note 
that  controllers  who  had  access  to  these  three  levels  of  displays  rarely  took  advantage  of 
the  lower  level  displays,  preferring  the  aggregated,  summarized,  and  filtered  displays. 

This  method  of  information  display  assumes  that  system  components  and 
information  about  system  components  can  be  structured  in  a  hierarchic  form.  For  a 
supervisory  or  monitoring  role,  the  human  controller  views  the  system  at  the  higher 
levels  or  possibly  drops  down  one  or  two  levels,  viewing  the  systems  as  a  collection  of 
hierarchical  subsystems.  The  switch  to  a  manual  mode  requires  that  the  controller 
descend  down  the  hierarchy  viewing  the  system  at  lower  and  more  detailed  levels,  likely 
requiring  lower  and  more  detailed  information.  This  notion  of  hierarchic  structure  is 
compatible  with  much  of  the  system  approach  to  design  as  well  as  models  of  human 
cognition.  The  problem,  of  course,  is  that  displays  of  this  type  are  not  easy  to  design, 
the  computer  is  a  new  display  medium  and  there  is  little  prior  experience. 


SUMMARY 


This  hierarohical  approach  to  information  display  has  several  advantages.  It 
explicitly  forces  the  system  designers  to  develop  a  set  of  human-oriented  system  models 
which  will  guide  the  design  of  the  displays.  By  designing  the  displays  around  the 
operator's  decision  making  needs,  the  displays  are  likely  to  become  more  human-oriented 
and  less  hardware-oriented.  By  trying  to  provide  the  appropriate  information  at  the 
appropriate  time,  there  is  likely  to  be  less  infonnation  displayed  at  any  given  time  and 
the  quality  of  the  displayed  information  will  require  less  operator  effort  to  integrate  into 
an  assimilatable  form.  A  very  pressing  problem  with  contemporary  control  rooms  is  that 
there  is  Just  too  much  information  for  an  operator  to  be  able  to  quickly,  easily  and 
accurately  assimilate.  Humans  are  easily  overloaded,  particularly  by  the  displays  of 
great  amounts  of  irrelevant  information  (Ackoff,  1967}  Seminara  et  al.,  1979).  Moreover, 
human  ability  to  integrate  multiple  pieces  of  displayed  data  into  meaningful  information 
is  very  limited  (Rouse,  1973;  1974}  1975).  As  a  result,  a  reasonable  and  perhaps  vitally 
necessary  direction  for  research  in  the  area  of  automated  control  room  design  is  to 
develop  displays  which  provide  active  decision  aiding  for  the  modern  controller,  displays 
which  provide  information  compatible  with  the  operators'  current  internal  model,  which 
filter  out  irrelevant  information,  and  which  summarize  and  condense  lower  level 
information  so  as  to  be  in  a  form  suitable  for  the  operator's  high  level  information  needs. 

Over  the  next  several  years,  NA8A*<3oddard  will  undertake  to  further  develop, 
implement,  and  evaluate  these  display  design  concepts.  They  will  be  implemented  on 
some  portion  of  the  automated  M80CC  system  and  actual  MSOCC  personnel  will  be  used 
as  sik)jects  in  an  experimental  evaluation. 
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HUMAN  -  COMPUTER  DIALOGUE  FRAGMENT 
FROM  THE  PROPOSED  AUTOMATED  MSOCC-1 
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ABSTRACT 


•---'Research  was  performed  to  determine  the  optimal  and  desirable 
qualities  of  a  keyboard  interfaced  with  a  remote  display.  The  key¬ 
boards  were  two  3  x  3  keyboards,  one  with  buttons  5.16  mm  In  diameter 
and  the  other  12.7  tin  square.  The  experimental  task  involved  subjects 
centering  a  set  of  crosshairs  on  a  cursor  on  a  CRT  (with  their  riaht 
hand),  while  simultaneously  selecting  modes  (with  their  left  hand)  on 
the  keyboards  without  observing  the  keyboards.  The  experimental 
design  was  as  follows:  (1)  two  keyboards;  (2)  three  orientations  of 
the  keyboard  (lb,  15  and  35  deg^eei)  from  the  horizontal  and  (3)  with 
and  without  gloves  (approved  ^rl^orce  flight  gloves).  This  design 
was  conducted  as  a  3  x  2  x  2  repeated  measures  factorial  design.  Per¬ 
formance  measures  were  resoonse  time  on  the  keyboards,  selection  errors 
on  the  keyboard  and  tracking  scores,  -'"a  -  ,  - 

..Results  of  this  study  ^indicate  that  mean  response  time  was  'fotimt^- 
-tabe^ significantly  lower  on  the  large  keyboard  when  examining  both 
keyboards  as  qwhole  and  with  and  without  gloves.  However,  error  rate 
was  not  founa  to  be  a  significant  factor  across  cpndl^tions.  In  addi¬ 
tion,  tracking  scores  were  found  to  be  signif1cant^”the  tracking  only 
versus  the  combined  task  condition.  No  specific  angle  was  found  to  be 
significant,  but  pilots  had  a  preference  for  the  15  degfw  (75%)  over 
the  other  two  keyboards.  Thus  the  results  ^f  this  stu<ly' indicate  the 
use  of  the  enlarged  keyboard  in  the  15  degfee^  orientation  when  using 
gloves. 

'A 

INTRODUCTION 


There  are  numerous  problems  involved  in  aircraft  cockpit  design. 
Two  problems  of  experimental  interest  are  display  location  and  panel 
design.  With  the  advent  of  single  function  electronic  displays  and 
digital  computers,  console  space  has  become  a  distinct  problem.  These 
problems  are  as  follows:  (1)  there  is  a  limit  to  the  space  available 
for  displays  on  aircraft  consoles;  (2)  there  is  a  limit  to  the  number 


of  functions  to  be  displayed;  (3)  these  functions  displayed  are  far 
below  the  actual  number  of  functions  a  pilot  must  perform;  (4)  in  a 
high  G  setting,  the  display  would  most  likely  be  located  outside  the 
pilot's  reach. and  vision  envelope. 

Various  military  contractors  have  designed  numerous  cockpit  input 
devices.  These  input  devices  include  keyboards,  light  pens,  joysticks, 
selection  buttons  and  touchwires.  Many  of  these  input  devices  have 
inherent  problems  when  incorporated  in  a  high  G  environment.  These 
problems  in  many  cases  cause  the  system  to  become  inoperable  in  a 
_crucial-high  G  situation. 

Armstrong  and  Poock  (1981)  at  the  Naval  Postgraduate  School  at 
Monterey,  California  investigated  voice  recognition  system  performance. 
They  identified  task  duration  and  increased  concurrent  operator  mental 
or  motor  workload  to  adversely  affect  performance  of  voice  recognition 
systems  even  in  simple  phrases  such  as  "VHF"  and  "UHF".  Lovesey  recom¬ 
mended  an  interactive  display  for  flight  functions  to  be  controlled. 

An  interactive  display  incorporates  numerous  functions  into  one  dis¬ 
play,  thus  allowing  the  pilot  to  use  additional  information  by  storing 
and  retrieving  it  whenever  necessary.  However,  Newman  and  Welde  (1981) 
delineated  numerous  problem  areas  with  these  devices  (i.e.,  the  field 
of  view  is  too  limited).  Researchers  at  Wright  Air  Base  studied 
several  different  multi -function  keyboard  designs  in  uhe  F-lll  and  A-7D 
fighter  aircraft  cockpits.  Their  designs  were  only  minimally  acceptable 
for  the  situation  involving  a  "look  but  can't  touch  and  the  touch  but 
can't  see"  due  to  the  design  needed  In  a  high  G  tilt-back  seat  (Bateman, 
Raising,  Herron,  and  Calhoun,  1978). 

Hottman  (1980)  developed  an  acceptable  solution  to  this  problem  by 
evaluating  three  multifunction  keyboards,  interacting  with  a  digital 
computer  which  selected  and  operated  many  of  the  controls  for  non-fly¬ 
ing  tasks  on  modern  military  aircraft.  Of  the  three  input  devices 
evaluated  (a  3x3  keyboard,  a  2x4  keyboard,  and  an  eight-position  joy¬ 
stick),  the  3x3  keyboard  was  determined  as  optimal.  In  arriving  at  this 
decision  he  neglected  to  examine  inclination  anole  of  the  keyboard  (from 
the  horizontal)  or  the  effect  of  gloves. 

Research  was  performed  concerning  the  design  of  controls  in  gloved 
conditions.  Huchingson  (1972)  examined  the  use  of  oloves  and  various 
pressure  suits  (ventilated  and  pressurized)  and  found  a  decrement  in 
dexterity,  gripping  strength  and  arm  speed  as  compared  to  the  bare  hand 
condition.  Chapanis  (1972)  also  examined  the  design  of  controls, 
however  none  of  his  design  recommendations  included  specifications  when 
using  gloves. 

The  keyboard  design  was  based  on  the  classic  study  conducted  by 
Fitts  and  Seeger  (1953),  Fitts  and  Seeger  exhibited  matched  stimulus 
(SR)  sets,  8  lights  every  45°  on  a  coordinate  circle,  to  determine 
which  resulted  in  the  best  overall  effectiveness.  The  best  SR  set  con¬ 
sisted  of  the  above  described  stimulus  set,  and  the  response  set  con¬ 
sisted  of  eight  pathways  radiating  from  a  central  point  like  spokes 
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on  a  wheel.  Another  principle  utilized  in  the  riesiqn  of  these  keyboards 
was  determined  by  Alden,  Daniels  and  Kanarick  (1972).  These  principles 
involved  standards  such  as:  key  dimensions:  diameter-1.27  cm,  center 
to  center  spacing-1.81;  force  and  displacement:  force-0.9  to  5.3  oz., 
displacement-0.13  to  0.64  cm,  keyboard  size:  a  miniaturized  keyboard 
for  touch  operations  causes  a  decrement  in  performance;  and  entry 
method:  chord  entry  is  faster  than  sequential  entry  for  tasks  like  mail 
sorting. 


In  measuring  performance  the  most  widely  used  objective  measure  is 
by  secondary  tasks  (Wierwille  and  Williges,  1978;  Brown,  1978;  Ogden, 
Levine  and  Eisner,  1979;  and  Chiles  and  Alluisi,  1979).  The  use  of 
secondary  tasks  is  based  on  the  assumptions  that  an  upper  bound  exists 
on  the  ability  of  the  human  operator  to  process  information  and  that 
the  mental  resources  which  form  this  limited  capacity  can  be  shared 
among  tasks.  The  methodology  requires  the  operator  to  perform  an 
extra  task  along  with  a  primary  task  of  interest.  Performance  measures 
are  obtained  by  comparing  single  and  dual  task  performance.  However, 
a  second  type  of  workload  theory  (Allport,  Antonis  and  Reynolds,  1972; 
Damos  and  Wickens,  1980;  and  Hirst,  Spelke,  Reaves,  Caharack  and  Neisser, 
1980)  assumes  that  the  information  processing  system  has  several  struc¬ 
ture-specific  capacities.  This  model  is  used  to  argue  that  the  second¬ 
ary  task  methodology  is  of  limited  value  because  obtained  workload 
measures  would  be  dependent  upon  the  degree  to  which  particular  primary 
and  secondary  tasks  share  common  mental  functions,  and  therefore,  common 
capacities. 


SUBJECTS 


Twenty-four  pilots  located  in  the  Bryan-Collene  Station  Area  parti¬ 
cipated  as  subjects  in  this  study.  Pilots'  ages  ranged  from  twenty-two 
to  fifty-two  years  of  age.  Pilot  experience  ranged  from  one-hundred 
to  ten  thousand  hours.  In  addition,  pilot  background  ranged  from  pri¬ 
vate  to  commercial  to  military. 


DESIGN 


This  study  was  conducted  as  a  3x2x2  repeated  measures  factorial 
and  pres;ntat1on  of  treatments  followed  a  12x12  latin  square  arrange¬ 
ment,  The  independent  variables  were:  (1)  two  keyboards  in  a  3x3 
arrangement  (one  with  5.16  mm  diameter  (small)  keys  and  one  with  12.4 
inn  square  (large)  keys);  (2)  the  angle  of  orientation  of  the  keyboard 
from  the  horizontal  (0®,  15®  and  35®);  and  (3)  with  and  without  USAF 
approved  flight  gloves.  Dependent  variables  were  tracking  score  on  a 
flight  simulation  task,  response  time  in  selecting  flight  modes,  and 
the  error  rate  in  selecting  flight  modes. 


APPARATUS 


The  mode  selection,  task  was  perfon.ied  on  a  Pet/Commodore  computer 
which  was  electronically  interfaced  to  two  keyboards  with  momentary-on 
pushbuttons. 

The  tracking  task  was  performed  on  an  Apple  II  computer  which  was 
electronically  interfaced  to  an  Everest  and  Jennings  joystick. 


PROCEDURE 


A  mode  was  defined  as  a  three  letter  acronym  of  a  non-flying  task. 
Modes  were  located  in  the  same  position  throughout  the  study  and  were 
as  follows:  VHP  (radio),  FLT  (flight),  NAV  (navigationK  PPR  (^uel 
pressure),  UHF  (radio),  OPR  (oil  pressure),  RPM  (revolutions  per  minute) 
and  ALT  (altitude).  A  sequence  was  defined  as  a  group  of  three  modes. 
Response  time  was  defined  as  the  amount  of  time  to  key  in  a  sequence 
of  modes  presented  aurally  to  the  subject.  Selection  errors  was  de¬ 
fined  as  selecting  the  incorrect  mode  or  selecting  modes  in  the  in¬ 
correct  order. 

Each  presentation  of  treatments  was  divided  into  sub-sessions: 

(1)  tracking  alone  and,  (2)  tracking  and  performing  the  mode  selection 
task  simultaneously.  Each  was  randomly  assigned  first  and  lasted  for 
two  minutes. 

Each  subject  made  five  different  selections  of  sequences  on  both 
keyboards  in  each  sub-session.  The  positions  on  the  displays  were  a 
spatial  analog  of  the  keyboard  the  subject  was  using.  An  example  of  a 
mode  selection  sequence  was  as  follows;  "select  VHK  RPM,  NAV."  The 
pattern  would  appear  and  the  subject  would  look  at  the  CRT  for  each 
mode  and  select  them  accordingly.  After  selecting  the  modes  (the  compu¬ 
ter  gave  them  feedback  by  beeping  when  each  mode  was  selected),  the  CRT 
went  baink.  The  computer  then  generated  a  new  sequence  (each  sequence 
was  generated  such  that  each  sequence  did  not  constitute  one  complete 
row  or  column)  which  was  then  transmitted  to  the  subject  at  the  appro¬ 
priate  time. 

The  operation  of  both  tasks  simultaneously  was  identified  as  a 
dual-time  sharing  task.  The  tracking  task  was  identified  as  the  most 
important,  however,  the  mode  selection  was  identified  as  nearly  as 
important. 


RESULTS 


Using  a  univariate  analysis  of  variance  for  repeated  measures  indi- 
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cated  that  response  time  using  the  large  keyboard  was  significantly 
briefer  than  for  the  small  keyboard  (pr  >  .05). 


A  summary  of  significant  statistics  can  be  seen  in  Table  1. 

Further  investigation  using  a  Duncan's  Multiple  Range  Test  (p  ■  .05) 
using  the  large  keyboard  without  gloves  was  significantly  briefer  than 
for  the  large  keyboard  with  gloves  and  the  small  keyboard  with  and  with 
out  gloves.  Surprisingly,  neither  keyboard  size  nor  gloves  affected 
the  number  of  keying  errors.  Tracking  accuracy  was  found  to  be  signi¬ 
ficantly  higher  in  the  tracking  only  condition  than  in  the  combined 
task  condition.  Angle  of  orientation  of  the  keyboard  did  not  signifi¬ 
cantly  affect  response  time,  keying  errors  or  tracking  scores  at  the 
.05  level  of  significance.  However,  pilots  preferred  the  15“  angle 
(75*)  as  assessed  by  a  post-test  questionnaire.  They  also  preferred 
the  large  keys  (75%). 


Table  1.  Summary  of  Significant  Statistics 


Mean  Response  Time  as  a  Function  of  Keyboard  sTze 

_ _ _  Response  T1mn  (sec) _ 

Large  Keyboard  Z.S7r  _ 

Sma)l  Keyboard  3.112 


Mean  Response  Time  as  a  Function  of  Keyboard  Size 
With  and  Without  Gloves 


Response  Time  (sec)  1 

Large  Keyboard 

With  Gloves 

'  2.6612 

Large  keyboard 
Without  Gloves 

3.0282 

Tiiiall  Keyboard 

With  Gloves 

3.1458 

Small  keyboard 
Without  Gloves 

3.0774 

Mean  Tracking  Scores  for  Tracking  Only 

and  Tracking  During  Mode  Selection 


CONCLUSIONS  AND  RECOMMENDATIONS 


The  results  of  this  study  Indicate  that  the  keyboard  with  the 
large  keys  (as  assessed  by  response  time  and  questionnaire)  in  the  15” 
angle  (also  assessed  by  questionnaire)  should  be  used  in  selecting 
modes  with  USAF  approved  flight  gloves  from  a  remote  display. 

Recommendations  for  future  research  are: 

1.  To  provide  for  a  higher  simulation  with  CRT  screens 
being  placed  one  on  top  of  the  other. 

2.  To  evaluate  another  3x3  keyboard  to  determine  optimality 
(i.e.,  moving  the  keys  closer). 

3.  To  evaluate  another  3x3  keyboard  with  the  middle  button 
to  determine  if  tactual  feedback  aids  in  performance. 

4.  To  further  investigate  angle  of  inclination  to  determine 
if  there  is  an  optimal  angle. 
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ABSTRACT 

fhis  paper  describes  plans  to  analyse  flight  control  response 
data  In  conjunction  with  RMS  error  information  in  an  attempt  to 
determine  how  pilots  process  information  in  a  aimulated  curved 
approach  and  landing  task  using  predictive  information  in  a 
perspective  display.  An  investigation  of  predictive  algorithms  in 
which  the  parameters  are  varied  across  the  levels  of  the  system 
control  hierarchy  was  conducted.  Preliminary  empirical  data 
indicating  a  relatively  long  response  period  for  flight  controls 
tends  to  suggest  that  the  nature  of  the  menCal  processes  involved 
are  cognitive  rather  than  perceptual.  Results  of  this  experiment 
also  indicate  that  pilot  control  response  is  directly  related  to 
the  hierarchical  order  of  the  predictor  algorithm.  Additional 
analyses  are  needed  to  determine  how  those  results  may  impact  the 
information  processes  used  in  these  tasks.  Because  the  data  were 
recorded  at  one-second  intervals,  an  additional  experiment  is 
planned  in  which  data  will  be  recorded  at  more  frequent  intervals 
to  validate  the  findings. 

A  SIMULATOR  STUDY 

In  a  flight  simulator  study  Jensen  (1981)  demonstrated  an  effective 
application  of  various  predictor  algorithms  to  visual  guidance  and 
flight-path  prediction  in  forward-looking  true-perspective  flight  displays 
using  a  computer  generated  CRT  display  as  shown  in  Figure  1.  In  this  study 
18  professional  pilots  each  flew  four  curved  landing  approaches  under 
varying  simulated  windshear  conditions  with  each  of  18  display 
CO  'gurations.  The  displays  represented  parametric  combinations  of 
til  second-,  and  third-order  predictive  flight  path  algorithms  and 
four  proportions  of  pursuit  prediction  versus  compensatory  quickening, 
plus  five  hybrid  display  configurations  and  a  conventional  crosspointer 
display. 
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Figure  1  here 


Figure  1.  Experimental  perspective  predictor  display. 

RMS  lateral  error  results.  Figure  2,  indicate  a  significant 
improvement  with  Increasing  proportions  of  pursuit  prediction.  Second- 
and  third-order  predictors  were  significantly  better  than  first-order 
predictors  but  were  not  significantly  different  from  each  other.  Best 
vertical  control,  Figure  3,  was  achieved  with  an  intermediate  combination 
of-predlction  and  quickening.-  Compared  with  the  coventlonal  crosspointer, 
the  best  experimental  displays  reduced  RMS  lateral  error  by  a  factor  of 
ten.  Vertical  error  was  also  reduced  but  by  a  lesser  amount. 


’Figure  2  here 


Figure  2.  BMS  lateral  error  as  a  function  of  percent  prediction  and 
computational  order. 


——Figure  3  here 


Figure  3.  RMS  vertical  error  as  a  function  of  percent  prediction  and 
computational  order. 

However,  the  most  Interesting  and  important  result  was  the  large 
statistically  significant  differences  in  aileron,  rudder,  and  elevator 
control  activity  between  displays  with  first-,  second-,  and  third-order 
prediction  algorithms.  Figure  4  shows  a  power  spectral  analysis  of 
aileron  control  movements  from  a  preliminary  study  of  six  of  the  displays 
tested  In  the  experiment.  It  can  be  seen  from  these  data  that  the  control 
strategies  vary  to  a  considerable  extent  from  one  display  to  another.  The 
conventional  crosspointer  (CP)  for  example  shows  large  amplitude  movements 
at  about  .075  HZ.  The  third-order  predictor  (3rdP)  and  the  third-order 
predictor  with  33  percent  quickening  (3rdPQ)  result  in  very  small 
amplitude  movements  throughout  the  frequency  spectrum.  Pilots  apparently 
were  overcontrolling  in  the  first  case  and  undercontrolllng  in  the  second. 
Similar  results  were  found  for  elevator  and  rudder  control  responses. 
These  results  may  be  considered  surprising  since  the  pilots  were  all 
highly  skilled  professionals  whose  response  patterns  should  have  been  well 
established  for  aircraft  control  prior  to  the  experiment. 


Figure  4  here 


Figure  4.  Power  spectral  analysis  of  aileron  control  responses. 
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The  data  suggest  the  need  for  rethinking  the  task  of  continuous 
control  of  higher*-order  systems.  In  all  cases  the  major  period  of  aileron 
control  activity  was  on  the  order  of  8~12  seconds.  Data  for  elevator 
control  (Figure  5)  indicate  a  major  period  on  the  order  of  3-10  seconds 
depending  on  the  display  dynamics  used.  It  may  be  that  these  major 
control  deciaions  are  made  discretely  at  the  cognitive  level,  whereas  the 
trial  and  error  searching  for  more  information  as  seen  in  the  lower-order 
predictor  displays  and  in  the  conventional  crosspointer  display  is  made  in 
a  continuous  fashion.  Clearly,  predictive  display  dynamics  have  a 
considerable  effect  on  the  amount  and  types  of  cognitive  processing  (and 
control  movements  required  for  perceptual  processing)  required  in  the 
control  of  an  aircraft  on  a  curved  approach. 


Figure  S  here 


Figure  5.  Power  spectral  analysis  of  elevator  control  responses. 

Plight  Task  Analysis 

In  an  analysis  of  the  pilot's  control  task,  a  significant  component 
that  can  be  identified  is  cognitive  prediction  resulting  from  the  mental 
transformations  required  by  the  aircraft  control  hierarchy.  For  example, 
to  correct  an  error  (due  to  disturbance  inputs,  pilot  control  errors,  or 
course  curve  adjustments)  in  the  horizontal  direction,  the  pilot  estimates 
the  amount  of  heading  change  that  is  necessary  to  effect  an  optimum 
correction.  Given  this  estimate  of  the  necessary  heading  adjustment,  the 
pilot  estimates  the  optimum  bank  for  that  heading  change.  Finally,  given 
an  estimate  of  the  necessary  bank  and  pitch,  the  pilot  estimates  the 
amount  of  aileron  control  movement  appropriate  for  that  amount  of  bank 
change.  Considering  the  vertical  component  that  must  be  controlled 
simultaneously,  the  cognitive  prediction  task  is  very  demanding.  This 
task  is  the  major  element  to  be  learned  initially  in  instrument  approach 
instruction  and  it  is  often  the  first  to  be  forgotten  in  the  loss  of 
Instrument  "currency.**  If  the  amount  of  control  power  is  proportional  to 
the  amount  of  cognitive  processing  involved,  then  the  most  effective 
display  would  be  that  which  causes  pilots  to  produce  the  least  amount  of 
control  power  and  error  in  both  the  lateral  and  vertical  modes. 

The  Perception-Action  Cycle 

The  research  work  by  Owen  and  his  associates  (Owen,  Warren,  Jensen, 
Mangold,  and  Hettinger,  1979)  suggests  that  perception  is  a  active 
process.  They  have  advanced  the  idea  that  a  considerable  amount  of  the 
control  activity  input  by  the  operator  of  a  vehicle  is  made  for  the 
purpose  of  obtaining  information  rather  than  correcting  error.  This  may 
explain  the  phenomena  that  we  see  in  the  lower-order  display  where  a  high 
level  of  control  activity  is  evidenced.  These  results  suggest  that  a 
detailed  analysis  of  control  style  is  essential  for  an  understanding  of 
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the  reasons  for  the  advantage  of  one  display  design  over  another  In  higher 
order  systems. 

Additional  Data  Analyses 

To  determine  the  effect  of  these  factors  additional  analyses  are 
needed  of  the  control  response  data.  Power  spectral  analyses  of  the  data 
obtained  from  each  of  the  1296  approaches  of  the  Jensen  (1981)  experiment 
are  being  made  in  an  attempt  to  determine  the  relationship  between  the 
hierarchical  levels  of  Information  in  the  predictor  algoritlm  and  control 
response  strategies. 

A  ^Jor  obstacle  to  these  analyses  is  the  fact  that  the  sampling  rate 
for  the  data  was  1  Hs.  Most  control  theorists  believe  that,  because 
humans  can  make  control  responses  at  the  rate  of  5  Hz,  data  should  be 
sampled  at  a  rate  not  less  than  10  Hz  to  avoid  losing  detail  in  the 
waveform.  The  reason  data  were  not  recorded  at  this  high  rate  in  the 
Jensen  experiment  (and  many  others  as  well)  was  that  the  limited  storage 
capacity  of  the  computer  made  it  prohibitive. 

On  the  other  hand,  a  number  of  factors  suggest  that  this  high  sampling 
rate  may  not  be  needed.  First,  if  the  primary  interest  is  the  analysis  of 
discrete  cognitive  responses  with  a  period  between  decisions  of  several 
seconds,  a  sampling  rate  of  10  Hz  amounts  to  overkill.  Second, 
consideration  should  be  glveu  to  the  frequency  response  of  the 
pilot-aircraft  combination.  During  the  approach  phase  of  flight,  aircraft 
dynamic  response  characteristics  are  typically  a  fraction  of  what  they  are 
capable  of  during  high  speed  flight.  In  addition,  on  an  ILS  approach  the 
pilot  usually  limits  the  bank  angle  of  the  aircraft  to  a  fraction  of  the 
what  he  normally  uses  for  normal  bracketing  procedures.  The  experienced 
professional  pilot  will  usually  make  his  course  corrections  only  after 
Slaking  estimates  of  the  outcome  of  each  control  Input.  Other  factors  that 
uay  cause  variability  in  control  response  strategies  are  pilot  experience, 
currency,  and  atmospheric  turbulence.  These  factors  considered  together 
could  produce  the  low  frequency  of  control  activity  found  in  the 
preliminary  experiisents  described  earlier. 

Therefore,  a  validation  experiment  is  planned  to  determine  the 
required  sampling  rate  acceptable  for  the  analysis  of  aircraft  approach 
and  landing  tasks.  The  point  at  which  the  accuracy  becomes  degraded  due 
to  insufficient  sampling  rate  can  be  determined  experimentally.  A  T-AO 
twin-jet  flight  simulator  will  be  used  to  fly  several  ils  approaches  using 
a  conventional  electro-mechanical  cross-pointer  display.  Data  will  be 
sampled  at  lOHz  using  a  Harris/6  Computer.  These  data  will  be  analyzed 
using  power-spectral  analysis  initially  at  10  Hz,  then  at  5,  2  and  1  Hz 
and  compared  with  each  ocher  co  determine  the  amount  of  loss  of  accuracy 
as  the  sampling  rate  is  decreased. 

Interpreting  Che  results  of  the  power  spectral  analysis,  one  must 
consider  the  magnitude  of  control  power  in  the  context  of  error  produced. 
Lower  control  power  is  indicative  of  lower  cognitive  processing  (and, 
perhaps  lower  mental  workload),  but  it  may  also  be  indicative  of 
undercontrolling  if  accompanied  by  high  levels  of  steering  error.  A 
correlation  of  control  power  and  RMS  error  would  be  useful  in  this  regard. 
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The  ideal  flight  display  is  one  that  allows  the  pilot  to  deliver  the 
aircraft  to  the  runway  with  the  least  anount  of  error  and  mental  workload. 
To  evaluate  these  parameters,  one  must  be  able  to  correlate  control  power 
with  error  at  various  positions  of  the  approach.  One  can  observe  from  the 
lateral  mode  spectral  and  error  analysis  for  example,  that  the  lowest 
power  does  not  necessarily  produca  the  lowest  error.  It  Is  also  evident 
that  superiority  In  the  lateral  mode  does  not  necessarily  produce  similar 
results  In  the  vertical  mode.  To  establish  an  order  of  merit  for  the 
display  factors  of  interest  each  of  these  parameters  must  be  used. 
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Power  epeccral  analysis  of  elevator  control  responses. 
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Abstract 

) 

The  prO|>o8ed  research  will  examine  differences  in 
reaction  time  and  task  completion  measures  as  a  function 
of  control-display  configuration  in  a  helicopter  cockpit 
environment*  The  two  configurations  to  be  compared  are 
ipsilateral  and  contralateral,  with  the  ipsilateral  confi¬ 
guration  defined  as  one  having  each  control 
(cyclic/velocity;  collective/altitude)  and  its  correspond¬ 
ing  instrument  placed  on  the  same  side.  The  contrala¬ 
teral,  conventional  helicopter  configuration,  is  the  con¬ 
verse.  Simultaneous  manipulation  of  altitude  and  velocity 
controls  will  be  required.  Fitts'  law  will  be  used  to 
provide  levels  of  task  difficulty. 

Introduction 


The  relationship  between  man  and  the  machine  he 
operates  is  particularly  Important  when  the  "machine"  is  a 
helicopter.  In  special  conditions,  such  as  night  or  foul 
weather  flying,  the  pilot  is  almost  completely  dependent 
upon  quick  and  reliable  feedback  from  the  aircraft's 
display  and  control  systems,  in  U.  S.  Army  NOB  maneuvers 
(nap-of-the-earth) ,  the  aircraft  is  flying  as  close  to  the 
earth's  surface  as  possible,  utilizing  trees  and  vegeta¬ 
tion  as  cover  from  enemy  radar,  and  is  often  only  split 
seconds  away  from  becoming  part  of  the  scenery.  These 
situations  demand  a  roan-machine  system  that  provides  a 
manageable  level  of  pilot  workload— and  critical  to  this 
is  the  rational  combination  of  control  position  and 
corresponding  instrument  placement. 

In  order  to  fly  a  helicopter  the  pilot  must  use  both 
hands  and  both  feet.  The  altitude  control,  called  the 
collective,  is  a  left-hand  control.  The  longitudinal  and 
lateral  velocity  control,  the  cyclic,  is  manipulated  with 
the  right  hand.  The  pilot's  feet  are  used  to  control  the 
tail  rotor  by  means  of  rudder  pedals.  In  roost  American- 
built  helicopters  the  instrument  panel  is  similar  to  that 
of  its  fixed-wing  counterpart.  The  traditional  arrange¬ 
ment  places  the  gauge  for  altitude  (controlled  with  the 
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left  hand)  on  the  right  side  of  the  panel,  and  the  gauge 
for  airspeed  (controlled  with  the  right  hand)  on  the  left 
side  of  the  panel.  This  display  arrangement  has  even  been 
carried  over  into  the  U.  S.  Army's  new  helmet-mounted 
display  of  flight  instruments  in  the  Pilot  Night  Vision 
System  (PNVS) .  In  the  PNVS  sight,  altitude  and  airspeed 
information  are  displayed  as  vertical  scales  on  the  right 
and  left  respectively  of  the  pilot's  line  of  sight  (see 
Figure  1).  The  conventional  helicopter  control-display 
configuration  is  not  in  line  with  stimulus-response  compa¬ 
tibility  theory — i.e.,  each  control  (cyclic/velocity; 
collective/altitude)  and  its  corresponding  instrument  are 
on  opposite  sides.  In  fact,  the  "incompatibility"  of  this 
configuration  may  add  to  the  amount  of  workload  and  cost 
the  pilot  valuable  extra  time. 

Stimulus-response  compatibility  research  has  indi¬ 
cated  that  reaction  time  is  faster  in  a  psychomotor  task 
when  the  required  response  is  in  the  same  direction  as  the 
stimulus.  A  previous  study  done  at  NASA-Ames  (Hartzell, 
Dunbar,  Beveridge,  &  Boothe,  elsewhere  in  these  proceed¬ 
ings)  compared  an  ipsilateral  control-display  configura¬ 
tion  with  the  conventional  (contralateral,  as  described 
above)  helicopter  configuration.  This  study  involved 
sequential,  discrete  tasks — changing  altitude  or 
airspeed — and  reaction  time  was  found  to  be  significantly 
faster  with  the  ipsilateral  arrangement.  The  proposed 
research  will  bring  the  experimental  situation  more  in 
line  with  the  real-world  helicopter  environment  (simul¬ 
taneous  manipulation  of  cyclic  and  collective  and  addition 
of  rudder  control)  to  test  whether  an  ipsilateral 
control-display  configuration  is  superior  in  a  multi¬ 
element  control  task. 

The  mathematical  paradigm  employed  to  provide  various 
levels  of  task  difficulty  will  be  Fitts'  law  (Jagacinski, 
Hartzell,  Ward,  &  Bishop,  1978).  In  the  analysis  of 
discrete  movements,  Fitts'  law  refers  to  the  log  linear 
relationship  between  the  difficulty  of  a  task  and  the  time 
required  to  complete  .it.  The  first  part  of  this  law 
states  that  the  time  required  to  move  a  pointer  from 
starting  position  over  a  given  distance  to  the  center  of  a 
target  increases  in  a  log  linear  fashion  as  the  index  of 
difficulty  increases  (see  Figure  2).  The  index  of  diffi¬ 
culty  is  defined  by  the  formula  L  ID  =  log^^  (2A/W)  where 
A  =  distance  from  the  home  position  to  the  center  of  the 
target  (amplitude);  W  =  width  of  target]  .  The  amplitudes 
and  widths  can  be  manipulated  so  that  there  are  several 
combinations  for  each  index  of  difficulty.  This  is  a 
demonstration  of  the  reciprocity  between  speed  and 
accuracy — more  accurate  movements  take  longer  to  accom¬ 
plish. 

According  to  the  second  part  of  Fitts'  law,  reaction 
time  will  remain  constant  (slope  of  0)  throughout  diffi¬ 
culty  levels;  Fitts  states  that  the  initial  response  to 
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the  presentation  of  the  stimulus  will  not  be  affected  by 
the  index  of  difficulty.  Therefore,  variations  in  reac¬ 
tion  time  can  be  analyzed  in  terms  of  differences  in 
control-display  configuration. 

Differences  in  reaction  times,  capture  times,  and 
task  completion  time  as  a  function  of  control-display  con¬ 
figuration  will  be  examined.  Two  hypotheses  will  be 
tested : 

1)  Fitts'  law  is  a  valid  paradigm  in  a  multi-element 
control  task;  and 

2)  in  a  multi-task  situation,  the  ipsilateral 
control-display  configuration  will  result  in  significantly 
better  performance  than  the  contralateral  control-display 
configuration . 

Demonstration  of  the  superiority  of  the  ipsilateral 
control-display  configuration  in  the  experimental  situa¬ 
tion  will  suggest  the  desirability  of  possible  cockpit 
modifications  to  improve  pilot  performance  in  actual  hel¬ 
icopter  maneuvers. 


Method 


Subjects.  Sixteen  non-helicopter  pilot  subjects  with 
normal  or  corrected  to  normal  vision  will  be  u3ed--elght 
for  each  control-display  configuration.  Subjects  will  be 
tested  initially  on  Jex's  (19S6)  "Critical  Tracking  Task" 
which  is  designed  to  measure  psychomotor  ability.  Sub¬ 
jects  will  be  classified  by  performance  on  this  task 
according  to  level  of  tracking  ability  (moderate  or  high), 
and  experimental  groups  will  be  matched.  Subjects  will  be 
randomly  assigned  to  two  experimental  conditions,  result¬ 
ing  in  two  groups  of  eight  subjects  each. 


Apparatus.  The  apparatus  will  be  similar  to  that 
used  in  the  previous  experiment  (Hartzell  et  al , ,  else¬ 
where  in  these  proceedings).  The  subject  station,  as  seen 
in  Figure  3,  is  modeled  after  the  control  station  of  a 
helicopter.  A  seat,  and  cyclic  and  collective  controls 
are  mounted  on  a  platform;  in  front  of  the  seat  is  a 
53.34-cm.  display  oscilloscope,  whicti  is  sloped  back  from 
the  vertical  by  four  degrees.  The  rudder  control  will  be 
added  for  this  study,  and  will  consist  of  foot  pedals 
mounted  on  the  platform.  The  control  dymanics  for  the 
cyclic,  collective,  and  rudder  will  be  independent  of  each 
other,  and  similar  to  those  of  an  AH-64  helicopter.  The 
rudder  will  operate  a  simple  k/s  plant.  presently  (sub¬ 
ject  to  modification)  ,  the  dynamics  of  the  collective  and 
cyclic  are  as  follows; 
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The  position  of  each  channel  (control)  will  be  recorded 
every  10  msec. 

_  The  display  (contralateral  configuration)  that,  will  . 
appear  on  the  oscilloscope  is  as  shown  in  Figure  1.  For 
the  ipsilateral  condition,  the  cyclic  and  collective 
displays  will  be  reversed.  This  display  is  comparable  to 
the  electronically-generated  symbology  that  is  displayed 
with  the  PNVS.  The  contralateral  arrangement  is  what  is 
conventionally  displayed  to  the  pilot.  Figure  1  also 
shows  pointers  and  sample  targets  for  the  cyclic  and  col¬ 
lective;  it  should  bo  noted  that  the  target  sizes  and 
locations  may  be  different  fpr  each  control.  The  rudder 
display  will  be  dynamic,  and  present  throughout  the  block 
of  trials.  The  compensatory  tracking  task  will  require 
the  subject  to  null  out  the  random-appearing  error  to  keep 
the  vertical  cursor  centered,  and  is  intended  to  be  a 
secondary  loading  task. 


Procedure.  Each  of  the  two  experimental  groups  will 
be  trained  and  tested  on  only  one  control  configuration— 
ipsilateral  or  contralateral.  The  secondary  task  (rudder 
control)  included  in  both  configurations  will  be  the  same 
for  the  two  groups.  All  subjects  will  be  trained  to  an 
asymptotic  criterion  before  data  measurements  are  taken. 
They  will  be  considered  to  have  reached  asymptote  when 
mean  performance  does  not  vary  more  than  5%,  and  standard 
deviations  do  not  vary  more  than  10%  for  a  period  of  eight 
sessions. 

For  each  primary  task  control  (cyclic  and  collec¬ 
tive)  ,  there  will  be  24  possible  targets.  These  will  be 
factorial  combinations  of  three  amplitudes,  four  target 
widths,  and  two  directions  (up  or  down  from  the  center)  . 
The  same  combinations  of  amplitudes  and  widths  will  be 
used  for  both  the  cyclic  and  collective  targets,  and  will 
yield  six  different  indices  of  difficulty  (as  calculated 
by  the  formula  ID  ■  log«  2A/W) .  The  sequences  of  target 
presentation  for  each  of  the  controls  will  be  independent; 
since  these  sequences  will  be  randomly  generated,  the 
resulting  mixtures  of  cyclic  and  collective  targets  will 
also  be  random. 

At  the  beginning  of  each  experimental  session,  prior 
to  the  first  trial  of  the  session,  the  rudder  task  will  be 
activated.  Subjects  will  be  instructed  to  use  the  foot 
pedals  to  keep  the  vertical  cursor  (see  Figure  1)  as  cen¬ 
tered  as  possible  for  the  duration  of  the  session.  A  red 
light  appearing  2  seconds  prior  to  the  trial  and  located 


at  the  bottom/center  of  the  oscilloscope  will  be  a  warning 
of  the  beginning  of  each  trial.  The  primary  display  (see 
Figure  1)  will  then  be  activated,  the  altitude  and  velo¬ 
city  displays  will  appear  simultaneously  at  the  beginning 
of  each  trial,  and  each  will  disappear  following  attain¬ 
ment  of  criterion  as  described  below.  If  criterion  is  not 
reached  after  30  seconds,  both  pointers  and  targets  will 
disappear  simultaneously.  The  vertical  scales  will  remain 
2  seconds  longer,  signalling  to  the  subject  that  the  task 
was  not  successfully  completed. 

The  subjects*  primary  task  will  be  to  manipulate  the 
cyclic  and_  collective,  so  as  to  bring  the  pointers  to  the 
areas  between  the  respective  target  lines  as  quickly  as 
possible  and  keep  them  steady  for  3S0  msec.  The  trial 
will  be  over  when  this  criterion  has  been  attained  for 
each  primary  target  and  both  pointers  are  within  the  tar¬ 
get  area,  or  30  seconds  after  appearance  of  the  display  if 
the  criterion  is  not  met.  There  will  be  a  T-second  inter¬ 
val  between  trials. 

Subjects  will  have  two  blocks  of  trials  per  day.  All 
of  the  trials  will  be  randomly  generated.  The  first  block 
will  consist  of  10  practice  trials,  and  36  data  trials  (6 
trials  for  each  index  of  difficulty) .  The  combinations  of 
targets  and  indices  of  difficulty  for  the  cyclic  and  col¬ 
lective  will  be  randomly  generated.  After  a  10-minute 
rest  period,  the  subject  will  receive  another  session  of 
36  data  trials.  Subjects  will  be  given  performance  feed¬ 
back  after  each  session  to  encourage  rapid  improvement. 
When  asymptotic  performance  for  each  subject  is  maintained 
for  a  period  of  4  days,  the  experiment  will  terminate. 
Data  for  these  4  days  (eight  sessions)  will  be  collected 
and  analyzed  as  outlined  below. 


Design  and  Analysis .  The  experimental  design  is  a  2 
(control  configuration)  x  2  (control)  x  8  (sessions)  fac¬ 
torial  with  repeated  measures  on  the  last  two  factors. 
Data  from  the  last  eight  sessions  will  provide  the  raw 
dependant  measures.  Three  different  types  of  measures 
will  be  taken:  reaction  time  (RT)  for  cyclic  and  collec¬ 
tive  (from  appearance  of  the  target  to  2%  deflection  of 
eaco  jontrol  stick);  capture  time  (CT)  for  cyclic  and  for 
collective  (from  end  of  RT  to  achievement  of  capture  cri¬ 
terion)  ;  and  total  time  (TT—  from  appearance  of  the 
display  to  end  of  trial)  .  Median  reaction  times  and  cap¬ 
ture  times  for  each  control,  and  total  times  for  each 
trial  will  be  calculated  for  each  subject's  performance  on 
each  of  the  six  indices  of  difficulty  for  each  of  the  last 
eight  sessions. 

It  is  hypothesized  that  a  regression  line  fitted  to 
each  subject's  data  over  sessions  on  capture  time  and 
total  time  will  demonstrate  the  log  linear  relationship 
posited  by  Fitts  (between  the  difficulty  of  a  task  and  the 


time  required  to  complete  it) •  This  demonstration  will  be 
based  on  high  correlation  coefficients  for  the  regression 
analyses.  It  is  also  hypothesized,  in  accordance  with  the 
second  part  of  Fitts'  law  (the  initial  response  to  the 
presentation  of  the  stimulus  will  not  be  affected  by  the 
index  of  difficulty) ,  that  the  slopes  of  the  regression 
lines  generated  by  RT  measures  on  each  of  the  indices  of 
difficulty  over  sessions  will  not  be  significantly  dif¬ 
ferent  from  zero. 

For  each  display  configuration,  each  subject's  median 
reaction  tiroes  for  each  control  for  each  difficulty  level 
will  be  averaged,  and  a  t  test  comparing  the  resulting 
regression  line  slopes~‘with  a  slope  of  zero  will  be  per- 
forroed  to  insure  that  there  is  not  a  significant  differ¬ 
ence.  Following  this,  the  slopes  and  intercepts  of  the 
regression  lines  generated  by  data  on  RT,  CT,  and  TT  as 
described  above  will  be  used  as  dependent  measures  in  six 
separate  2x2x8  analyses  of  variance,  one  for  the  slope 
and  one  for  the  y-intercept  of  each  time  measure. 

The  number  of  control  reversals  (initial  movement  in 
the  wrong  direction)  will  also  be  recorded.  An  examina¬ 
tion  of  the  data  should  show  less  reversals  for  the  ip^i- 
lateral  condition  than  for  the  contralateral  conditicn. 
Analysis  of  the  data  generated  by  the  rudder  control  w  11 
be  an  RMS  error  analysis.  It  is  hypothesized  the  error 
should  be  greater  with  the  contralateral  control-  display 
configuration. 

The  above  analyses  should  confirm  the  research 
hypotheses  in  the  following  way: 

1)  The  regression  lines  that  will  be  fit  to  each 
subject's  data  according  to  index  of  difficulty  on  each  of 
the  three  time  measures  will  demonstrate  the  applicability 
of  the  Fitts'  law  paradigm  to  a  multi-task  situation. 

2)  The  y-intercepts  of  the  reaction  time  regression 
lines  will  be  significantly  lower  for  the  ipsilateral 
control-display  configuration  than  for  the  contralateral 
configuration.  Regression  line  slopes  for  capture  time 
and  total  time  measures  will  be  significantly  lower  for 
the  ipsilateral  configuration* 

Confirmation  of  these  expectations  would  indicate 
that  the  existing  helicopter  instrument  arrangement  may  be 
neither  as  compatible  nor  as  efficient  as  is  desirable  in 
time-critical  flight  situations. 
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ABSTRACT 

'  < 

The  reported  study  addresses  the  question  of  the  spa¬ 
tial  arrangement  of  helicopter  instruments  and  controls 
in  terms  of  stimulus-response  compatibility.  The  results 
indicate  that  in  airspeed  and  altitude  adjustment  tasks 
the  compatible  placement  of  controls  and  displayed  infor¬ 
mation  may  result  in  a  significant  time  savings  and 
reduced  workload  and  therefore  increased  mission  perfor¬ 
mance.  Fitts'  Law  is  used  as  a  dependent  measure  to 
assess  the  performance  of  subjects  in  a  discrete  manual 
control  task. 

INTRODUCTION 

Military  helicopter  pilots  are  now  required  fly  day/night,  all 
weather  missions  at  low  levels  and  high  speeds  in  order  to  avoid 
detection  by  radar.  This  scenario  introduces  conditions  requiring 
rapid  and  correct  responses  by  the  pilot  in  order  to  avoid  obsta¬ 
cles  and  complete  the  mission  without  mishap.  Low-level,  high¬ 
speed  flight  is  the  most  demanding  in  terms  of  performance  and 
workload  of  all  the  missions  in  aviation.  Every  effort  must  be 
made  to  improve  the  interface  between  the  pilot  and  aircraft  in 
order  to  provide  the  widest  margin  of  safety  possible.  This  study 
was  undertaken  to  investigate  one  aspect  of  the  pilot  interface 
problem.  The  problem  is  one  of  stimulus-response  (S-R)  compati¬ 
bility  between  instrument  placement  and  control  position  in  cur¬ 
rent  and  near-future  helicopters. 

The  altitude  indicator  in  most  helicopter  instrument  panels  is 
located  to  the  right  of  the  pilot's  line  of  sight  (LOS)  while  the 
airspeed  indicator  is  located  to  the  left.  Both  instruments  are 
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typically  located  near  the  top  o^  the  instrument 
indicating  their  importance  in  the  -flight  control  task.  The 
initial  decision  to  place  these  instruments  in  this  arrangement 
was  based  on  fixed-wing  tradition  rather  than  the  unique 
requirements  of  modern  rotocraft  operations  and  flight  scenarios. 
Specifically,  changes  in  altitude  (depicted  to  the  right  of  the 
pilot’s  LOS)  are  effected  by  manipulation  of  the  collective  in  the 
left  hand.  The  airspeed  (displayed  to  the  left  of  the  pilot’s  LOS) 
is  controlled  by  the  cyclic  stick  in  the  right  hand. 


The  above  suggests  a  condition  of  S-R  incompatibility  between  the 
instruments  and  their  respective  controls.  That  is,  there  is  a 
lack  of  simple  spatial  correspondence  between  salient  perceptual 
dimensions  and  the  organization  of  responses  for  the  performance 
of  a  skilled  task.  Conflicts  that  might  result  from  this  incom¬ 
patible  arrangement  are  not  only  intuitively  apparent,  but  have 
been  associated  with  slower  response  times  and  higher  error  rates 
in  choice  reaction  time  studies  (ref.  1)  when  there  was  no  simple 
geometric  correspondence  between  the  stimulus  (light)  and  the 
required  response  (stylus  movement).  Thus,  it  is  possible  that  in 
the  control  of  a  helicopter  in  precision  maneuvers,  valuable  time 
is  lost  and  confusion-induced  errors  made  due  to  a  lack  of  S-R 
compatibility.  This  may  be,  in  turn,  a  contributing  factor  to  the 
high  level  of  pilot  workload  associated  with  low  alt  tde,  high 
speed  helicopter  operations. 


This  lack  of  S-R  compatibility  has,  through  tradition,  been  car — 
ried  forward  into  the  cockpit  of  the  US  Armys’  advanced  design 
helicopters.  These  rotocraft  are  specifically  designed  to  fly  all 
weather,  day/night,  nap-of-the-earth  (NOE)  missions.  To  accomplish 
these  missions,  the  pilot  is  equipped  with  a  helmet-mounted  monocu¬ 
lar  CRT  display  of  the  outside— the-cockpit  scene.  The  scene  is 
produced  by  a  Forward  Looking  Infrared  (FLIR)  camera  which  is 
gimbal -mounted  in  the  nose  of  the  helicopter.  The  movement  of  the 
camera  is  slaved  to  the  head  movements  of  the  pilot.  Sensors 
located  on  the  helmet  and  referenced  to  cabin  mounted  emitters 
detect  pilot  head  movements  and  convert  these  movements  into 
commands  to  direct  the  FLIR  camera  in  azimuth  and  elevation. 
Superimposed  on  the  display  of  the  outside  scene  of  the  passing 
world  is  a  collection  of  flight-related  symbology  elements  which 
are  Intended  to  take  the  olace  of  the  standard  panel  instruments 
(see  Fig.  1  ).  The  total  system  of  FLIR  and  hel mot -mounted  dis¬ 
play  is  known  as  the  pilot  night  vision  system  (PNVS) .  Note  that 
the  airspeed  is  shown  on  the  left  side  of  the  hel met— mounted 

display  and  the  altitude  indicator  is  located  on  the  right  side  of 
the  display.  Thus,  even  in  the  most  modern  of  helicopter  designs 
incorporating  the  highest  levels  of  technology,  the  traditipn  of 
S-R  Incompatibility  prevails.  With  the  rapid  advances  in  tech¬ 
nology  and  the  increase  in  demands  on  the  pilot  this  may  be  the 
time  to  reconsider  the  positioning  of  displayed  information  in  the 
cockpit  of  modern  helicopters. 
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Figure  1.  Flight  related  symbology  super¬ 
imposed  on  the  display  of  the  outside  scene 
as  seen  by  the  pilot  In  the  Pilot  Klght  Vision 
System  (PNVS) . 


Figure  2.  The  task  requires  that  the  pilot  act 
as  a  regulator  to  close  two  control  loops,  one 
each  for  altitude  and  airspeed. 


It  can  b»  argued  that  training,  experience,  and  learned  scan 
patterns  may  outMeigh  any  adverse  e-f-fects  on  performance  or  mental 
workload  due  to  S“R  incompatibility.  However,  the  impact  that  the 
position  of  these  two  primary  instruments  has  on  the  pilot's 
control  task  should  be  determined  by  objective  research  rather 
than  by  tradition.  To  this  end,  a  PNVS-type  display  was  simulated 
and  subjects  were  required  to  effect  changes  in  airspeed  and 
altitude  in  one  of  two  conditions.  The  first  was  the  control/dis- 
play  compatible,  or  ipsi lateral  arrangement  where  the  control  and 
corresponding  display  were  on  the  same  side.  -  The  other  condition 
was  the  control /di splay  incompatible,  or  contralateral  arrangement 
where  the  control  and  corresponding  display  were  on  opposite  sides 
of  the  subject's  LOS. 

The  research  question  of  interest  may  be  stated  as  :  "Is  there 
any  difference  in  the  time  required  to  effect  control  when  the 
controlled  element  is  contralateral  (current  arrangement)  or  ipsi- 
lateral  (stimulus  response  compatible  arrangement)  to  the  control 
manipulator?" . 


Experimental  Considerations 

The  research  question  introduced  above  involves  several  considera¬ 
tions  which  must  be  taken  into  account  when  formulating  the  ex¬ 
perimental  objectives  and  procedures  in  order  to  project  the 
results  to  the  real  world.  These  considerations  are;  (1>  stimu¬ 
lus  input;  (2)  response  output;  and  (3)  measurement  of  perfor¬ 
mance.  The  pilot  may  be  viewed  as  a  regulator  whose  task  is  to 
close  two  control  loops  as  depicted  in  Fig.  2.  The  perception  of 
the  visual  stimulus  serves  as  the  input  and  the  motor  control 
reflects  the  output.  In  the  currant  study,  the  control  position, 
instrument  spatial  and  visual  angle  relationship,  is  modeled  after 
the  PNVS. 

ifeiiDyiys  iQEyfei 

As  mentioned  above,  in  night  NOE  flight,  electronically  generated 
symbology  is  presented  on  the  helmet-mounted  display  to  provide 
the  pilot  with  flight  instrument  information.  The  PNVS  airspeed 
and  altitude  information  indicators  are  located  approximately  +/- 
15  degrees  about  the  vertical  center  reference  line.  The  same 
visual  angles  were  maintained  on  a  fixed  CRT  display  mounted  above 
an  instrument  panel  to  simulate  the  PNVS  arrangement.  A  schematic 
r  epresent  at  i  on  of  the  two  displays  used  can  be  seen  in  Fig. 

The  pilot  is  viewed  as  a  regulator  that  responds  to  a  detected 
error  and  is  required  to  bring  a  system  back  into  balance.  Simpli¬ 
fied  airspeed  and  altitude  responses  to  the  cyclic  (right  hand) 
and  collective  (left  hand)  controls  respectively  were  simulated. 
The  airspeed  and  height  control  plant  dynamics  are  quite  different 
and  the  regulator,  the  pilot,  uses  different  muscle  bundles  to 
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•ff»ct  control.  The  two  hands  are  placed  in  different  orienta¬ 
tions  to  the  body  and  the  collective  (height  control)  requires  an 
up/down  motion,  whereas  the  cyclic  requires  a  "stirring"  motion  in 
a  more  or  less  horizontal  plane. 

£gcls!i(DaQEe  Meaty cgfflgQfel 

Simple  reaction  time  measurements  could  be  used  as  the  primary 
performance  metric*  however  reaction  is  only  the  first  segment  of 
the  overall  control  task.  Since  the  pilot  is  acting  as  a  regula¬ 
tor  in  a  closed  loop  control  system,  the  task  i s  to  reduce  per¬ 
ceived  errors  to  an  acceptable  level.  Therefore,  the  control 
movement  "time  “to  a  achieve  a  criterioh  “is  a  major  "  variable  "of 
interest.  The  total  time  required  to  achieve  control  includes  the 
pilot  reaction  time  and  the  manipulator  movement  time,  thus  all  of 
these  variables  were  measured  in  this  study.  The  task  will  be 
defined  in  more  detail  in  the  following  section.  In  brief,  the 
subjects  were  asked  to  bring  a  pointer  to  a  specific  position  on 
the  simulated  PNVS  thermometer  scales  using  one  of  the  described 
helicopter  controls,  while  measurements  of  the  above  times  were 
recorded.  The  task  was  analagous  to  a  pilot  reaching  a  new  comman¬ 
ded  altitude  or  airspeed  by  manipulation  of  the  flight  controls. 

ANALYTIC  APPROACH 

A  suitable  model  to  employ  in  structuring  the  analysis  and  design 
of  this  experiment  was  proposed  by  Fitts  and  Peterson  (ref.  2) j 
the  resulting  mathematical  relationship  became  known  as  Fitts' 
Law.  They  found  that  there  exists  a  leg  linear  relationship 
between  speed  and  accuracy  of  response  movements  to  tasks  of 
varying  difficulty.  The  relationship  is  expressed  by: 

ID  =  a  +  b  log^2A/W  (1) 

Where:  A  »■  the  amplitude  of  the  initial  error 

W  =  the  width  of  the  target  area 
ID  »  the  index  of  difficulty  expressed  in  bits 
a  and  b  are  constants 

The  findings  of  Fitts  and  ethers  indicate  that  the  time  to  effect 
a  reduction  in  an  initial  error  of  amplitude  (A)  to  a  given 
criterion  target  width  (W)  varies  in  a  linear  fashion  with  the 
index  of  difficulty  (ID).  Regression  lines  are  fit  to  the  data 
produced  from  experiments  in  which  the  time  to  respond  and  the 
time  to  reach  the  target  area  are  measured  as  a  function  of  the 
difficulty  of  the  task.  Those  two  regression  lines  may  be  seen  in 
Fig.  4.  Fitts’  Law  predicts  that  the  reaction  time  regression  lino 
will  have  a  slnpe  (m^)  which  is  very  near  zero.  The  intercept  (yj.) 
of  this  function  will  be  an  estimate  of  the  response  time  for  all 
difficulty  levels.  The  movement  time  regression  line  (m^)  will 
have  a  slope  not  equal  to  zero.  This  indicates  that  as  the  task 
becomes  more  difficult  (established  by  the  ID),  more  time  is  re¬ 
quired  to  move  to  the  target.  Thus,  the  task  with  the  greatest 
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Figure  A.  Regression  lines  fit  to  the  data  where  the  time  to 
respond  and  the  time  to  reach  the  target  area  are  measured  as 
a  function  of  the  difficulty  of  the  task.  Task  difficulty  Is 
shown  on  the  abscissa  as  a  contlnulm  from  easy  to  hard.  Note 
that  the  slope  of  the  reaction  time  regression  line  (m^^)  Is 
plotted  as  zero,  and  the  slope  of  the  movement  time  regression 
line  (mn,)  la  greater  than  zero.  The  y- intercepts  (yr  and  y„) 
are  indicated  on  the  ordinate. 
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amplitude  (A)  and  the  narrowest  target  width  (W)  will  result  in 
the  longest  movement  time. 


Jagacinski,  et  al .  (ref.  3)  replicated  Fitts'  work  using  sero- 
and  first-order  control  dynamics  as  well  as  a  variation  in  the 
capture  criteria.  Their  task  involved  a  joystick  manipulator  and 
»  CRT-displayed  task  very  much  like  the  current  experimental 
display.  Although  different  slopes  were  obtained  for  the  sero- 
and  first-order  systems,  the  linear  relationship  predicted  by 
f^itts  held.  Others,  (refs.  4,5)  have  also  extended  Fitts'  Law  to 
include  up  to  first- order  dynamics.  All  have  found  the  relation¬ 
ship  described  by  Fitts  for  a  pure  manual  position  reponse  task  to 
be  robust  for  higher  order  dynamics  implemented  with  CRT  or 
visually  coupled  tasks. 

The  Fitts’  Law  model  structure,  used  in  a  control  theoretic  sense, 
lends  itself  well  to  answering  the  current  research  question.  If 
the  spatial  relationship  between  the  controller  and  the  controlled 
element  makes  no  difference,  then  the  slope  of  the  movement  time 
to  index  of  difficulty  function  will  not  differ  significantly,  no 
matter  where  the  indicator  is  placed  relative  to  the  control 
device.  Fitts’  Law  also  predicts  that  the  index  of  difficulty 
will  have  no  impact  on  the  slope  of  the  reaction  time  regression 
line  (my.), thus,  a  slope  of  zero  was  predicted.  Differences  in  the 
y-intercept  of  the  reaction  time  function  will  be  a  predictor  of 
any  differences  in  response  time  between  the  contralateral  or 
ipsilateral  control /di spl ay  arrangement.  Differences  between  the 
slopes  of  the  altitude  and  airspeed  or  collective  and  cyclic 
movement  time  regression  lines  were  predicted  because  the  plant 
dynamics  are  first-  and  second-order  respectively.  Differences  in 
the  slopes  of  the  movement  time  regression  lines  as  a  function  of 
the  ipsilateral  or  contralateral  arrangement  will  indicate  that 
the  effects  have  propagated  beyond  the  initial  response  and  into 
the  control  phase  of  the  task. 


METHOD 


iUiJieii: 

Sixteen  non— hei i copter— r ated  subjects  with  normal  or  corrected  to 
normal  vision  were  employed  as  members  of  the  subject  pool.  A 
screening  procedure  was  used  in  selecting  subjects  to  insure  that 
all  possessed  at  least  a  minimum  amount  of  psycho-motor  ability. 
Subjects  performed  the  Jex  Critical  Tracking  Task  (ref.  6)  and 
were  selected  to  participate  if  their  score  on  the  Critical 
Tracking  Task  was  equal  to  or  above  one  standard  deviation  below 
the  mean  of  a  distribution  of  scores  produced  by  helicopter  pilots 
and  other  persons  known  to  have  good  motor  skills.  The  subjects 
were  then  randomly  assigned  to  two  groups;  eight  to  the  contrala¬ 
teral  and  eight  to  the  ipsilateral  conditions.  In  each  group,  four 
were  high  performers  and  four  wert?  moderate  as  determined  by  their 
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scores  on  the  crii^terion  task  to  balance  the  tracking  skills  o-f  the 
two  groups.  ^ 

eeeeBQius: 

Cyclic  and  collective  controls  and  a  seat  typical  of  a  helicopter 
were  mounted  on  a  platform  with  a  suitable  rack  on  which  a  S3  cm 
oscilloscope,  sloped  back  from  the  vertical  by  four  degrees,  was 
mounted.  This  arrangement  was  referred  to  as  the  subject  station 
and  is  seen  in  Fig.  5.  The  cycl ic  icontrol- sti ck  had  breakout 
forces'  of  317. Sg  forward  and  408. 2g  aft  and  force  gradients  of 
lS3.6g/cm  and  108.9g/cm  respectively.  The  cyclic  stick  was  spring 
loaded  for  center  return  with  a  travel  of  •♦•/-  14  degrees  about  the 
center  position.  The  left  side,  floor-mounted  collective  control 
stick  was  63.Scffl  long  with  an  angular,  motion  of  +/-  10  degrees 
about  a  detent  which  was  provided  such  that  the  subjects  could 
return  the  control  to  a  zero  position  by  feel  between  trials.  The 
friction  of  the  collective  control  was  adjustable  and  was  left  to 
the  subject  to  establish.  However,  too  much  friction  masked  the 
feel  of  the  detent  and  too  little  did  not  restrain  the  collective 
control  from  falling  of  its  own  weight.  As  a  result  only  a  narrow 
band  of  friction  adjustments  was  selected  by  the  subjects. 


EUafcll  BVNAtjICg: 

The  plant  dynamics  were  implemented  on  a  digital  computer.  The 
transfer  function  for  the  collective  controlled  altitude  rate 
plant  was, 

!0L  ^  (2) 

and  the  cycl i c-control led  pitch  attitude/airspeed  plant,  a  reduced 
order  function  representative  of  a  "SCAS  on"  (stability  and 
control  augmentation  system)  system,  was  implemented  to  reflect 
changes  in  airspeed  as  a  function  of  changes  in  deflection  in  the 
cyclic  stick.  The  transfer  function  is  e^^pressed  in  two  parts  as 
f ol lows: 

±  a  _  vaJ 

Sj.~  Csi  -IS)*-  +«-»r>c/'<i>s  •*  ( »•»  ‘3) 

combined  with  the  gravitational  constant  yields, 

4  =  ^  (S)  ft, 

S*  s7ji  SeZln  (4) 

by  expansion,  the  resultant  transfer  function  is, 
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This  function  represents  a  simplified  small  perturbance  model  of  a 
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Figure  6.  In  manipulation  of  the  cyclic,  the 
subject  performs  a  two  stage  task  requiring  a 
change  In  pitch  attitude  before  a  change  in 
airspeed  can  occur. 


Figure  5.  The  subject  station  with  cyclic, 
collective,  and  seat  typical  of  a  helicopter 
showing  also,  the  CRT  and  a  sample  task 
display. 
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high  performance  helicopter,  trimmed  at  approximately  80  kts  and 
out  of  ground  affect. 

The  subjects  were  required  to  establish  a  commanded  rate  of  change 
in  height  with  the  collective  control,  in  accordance  with  equation 
(2)  as  represented  by  the  amplitude  <A)  on  the  display  to  an 
indifference  threshold  indicated  by  the  target  width  (W>  as  is 
depicted  in  Fig.  3.  In  the  case  of  the  cyclic  stick,  the  subjects 
were  required  to  establish  a  new  commanded  airspeed  by  controlling 
the  plant  expressed  in  equation  <5) ,  above  or  below  the  trim 
condition.  This  required~a  two” stage  task  in  that  the  pitch  atti¬ 
tude  must  first  be  changed  in  order  for  a  change  in  airspeed  to 
occur.  This  two  stage  task  may  be  seen  in  Fig.  6.  Mhen  a  velocity 
change  is  commanded  (Vc),  an  error  is  detected  between  the  current 
state  and  the  commanded  airspeed  represented  by  <Ve> .  This  defines 
the  outer  loop  control  task  of  the  pilot  or  pilot  task  1.  However, 
pilot  task  2  must  be  accomplished  first  before  the  desired  air¬ 
speed  <u>  is  obtained.  The  inner  loop,  pilot  task  2,  consists  of 
adjusting  the  pitch  attitude  (0)  by  means  of  the  deflection  (Sa)  of 
the  cyclic  control  such  that  the  desired  relationship  between 
pitch  attitude  and  resultant  airspeed  results. 

Early  in  the  learning  phase  of  the  experiment  the  subjects  were 
unable  to  accomplish  the  task  without  pitch  attitude  information 
presented  on  the  task  display.  However »  as  each  subject  became 
proficient  in  the  task,  the  pitch  attitude  information,  seen  in 
the  center  of  each  display  case  in  Fig.  3  as  an  artifical  hori¬ 
zon,  was  removed.  The  withdrawal  of  the  display  resulted  in  a 
small  setback  in  the  learning  curve  which  was  overcome  by  all 
subjects  in  a  short  time. 

esQSgsyGgs: 

Subjects  were  seated  in  the  subject  station  in  a  darkened  room  so 
that  their  eyes  were  approximately  60  cm  from  the  oscilloscope. 
They  communicated  with  the  experimenter  through  a  microphone  and 
headset.  At  the  beginning  of  each  trial,  a  red  light  appeared  in  a 
photographic  dark  field  on  the  center  LOS  of  the  subject,  and 
declined  by  17  degrees  from  the  horizontal. 

The  subjects  were  instructed  to  fixate  this  light  for  two  seconds. 
At  the  end  of  two  seconds,  the  display  to  the  left  or  right  was 
activated  with  one  of  the  instrument  display  cases  seen  in  Fig.  3 
and  dependent  on  a  random  and  balanced  schedule  .  The  displayed 
cases  were  centered  about  the  LOS  by  IS  degrees  resulting  in  a 
total  visual  angle  of  30  degrees  in  the  horizontal. 
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The  subjects'  task  was  to  manipulate  the  appropr i at.«'  control  so  as 
to  bring  the  pointer  between  the  two  target  lines  a*  quickly  as 
possible.  When  the  pointer  had  remained  "steady"  witnln  the  target 
area  for  350  msec,  the  trial  was  over  and  the  display  disappeared 
from  the  screen.  The  steadiness  criterion  was  defined  as  the 
smoothed  estimate  of  the  pointer  velocity  remaining  less  than  or 
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•qual  to  0.5  degrees  per  second  over  a  sampling  interval  of  350 
msec.  Following  the  end  of  each  successful  trial ,  the  screen 
remained  blank  for  two  seconds  and  the  next  trial  began  with  the 
illumination  of  the  fixation  light.  If  the  subject  failed  to 
achieve  the  350  msec  capture  criterion  within  30  sec  of  the 
appearance  of  the  target  and  pointer,  the  trial  automatically 
ended.  The  vertical  lines  in  the  display  remained  for  two  seconds, 
but  the  target  and  pointer  disappeared  as  a  signal  to  the  subject 
of  failure  to  meet  the  criterion. 


egiieb! 

A  repeated  measures  group  design  was  used  for  the  structure  of  the- 
experiment  and  subsequent  analysis  (ref.  7),  Each  repeated  exper- 
imental  session  consisted  of  72  trials,  six  data  trials  for  the 
six  indices  of  difficulty  for  each  of  the  two  controls  (cyclic  and 
collective).  The  difficulty  levels  were  generated  from  a  combina¬ 
tion  of  three  amplitudes  (A)  and  four  target  widths  (Ul)  resulting 
in  difficulty  indices  of  2.3,  3.1,  3.9,  4.7,  5.5,  and  6.3  bits, 

and  two  directions  (target  above  or  below  the  center).  The  order 
of  presentation  followed  a  two-part  schedule.  During  the  first 
experimental  session  of  each  day  a  subject  received  ten  practice 
trials  of  randomly  mixed  indices  of  difficulty  cases.  Practice 
trials  were  followed  by  72  data  trials  consisting  of  a  random 
ordering  of  cases  with  the  constraint  that  each  of  the  six  cases 
appeared  twelve  times  (six  cyclic  and  six  collective).  The  second 
session  proceeded  with  the  same  format  (omitting  the  practice 
trials)  after  a  ten  minute  rest  period. 

The  design  of  the  experiment  called  for  a  period  of  four  days  (0 
sessions  of  72  trials  each)  during  which  asymptotic  performance 
was  maintained  by  each  subject.  Asymptotic  performance  was  defined 
as  a  change  in  variability  (as  measured  by  the  standard  deviation) 
of  no  more  than  lOX  over  a  four  day  period  and  no  mors  thari  a  5X 
change  in  the  mean  of  reaction  and  capture  times  over  the  same 
period.  This  requirement  was  the  factor  which  determined  the 
number  of  days  each  subject  participated  and  thus  the  total  number 
of  days  of  the  experiment.  The  average  number  of  days  to  asympto¬ 
tic  performance  par  subject  was  18  days  or  40  hrs  of  training. 

Data  ware  sampled  at  a  rate  of  100  samples  per  second  per  channel 
(10  msec  sampling  rate)  for  the  collective  and  the  cyclic.  The 
occurrence  of  control  reversals  (selecting  the  right  control  but 
with  movement  in  the  wrong  direction)  and  blunders  (selecting  the 
wrong  control)  ware  also  recorded. 

RESULTS 

Mean  and  median  reaction  and  movement  times  were  calculated  for 
each  subject's  performance  on  each  control  for  the  six  indices  of 
difficulty  over  the  last  sight  sessions.  The  median  was  chosen  as 
the  proper  measure  of  central  tendency  due  to  a  mild  skewness  of 
the  time  measures.  Further,  the  initial  ANOVA  indicated  that  there 
was  no  days  effect,  consequently,  the  data  were  collapsed  over 
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eight  repl ications.  The  nonsignificant  results  of  this  ANOVA 
support  the  choice  of  the  criteria  for  the  definition  of  asympto¬ 
tic  performance  in  this  experiment. 

A  separate  linear  regression  line  was  fit  to  each  subject's  reac¬ 
tion  and  movement  times  for  each  of  the  two  controls,  as  a  func¬ 
tion  of  the  index  of  difficulty.  The  results  of  this  regression 
analysis  demonstrated  that  the  correlation  coefficients  for  the 
reaction  time  functions  were  relatively  low.  This  was  to  be  expec¬ 
ted  as  the  slopes  of  the  reaction  time  regression  lines  approached 
zero.  However,  the  correlation  coefficients  for  the  individual 
subjects  regression  functions  for  movement  times  ranged  from 
-approximatl y  0.94 -to  0.99  for  the  collective  control  and  0.96  to 
0.99  for  the  cyclic  stick. 

Siven  the  relatively  high  correlation  coefficients  obtained  for 
the  individual  subjects,  the  slopes  and  intercepts  of  the  regres¬ 
sion  lines  were  used  as  dependent  measures  in  four  separate 
ANOVA' B,  one  each  for  the  slopes  and  for  the  intercepts  of  the 
reaction  and  movement  time  measures.  The  results  of  the  ANOVA 
procedures  are  summarized  in  Table  1. 

The  analysis  of  the  reaction  time  (RT>  measures  indicated  no 
effect  for  the  slope  (m>  of  the  regression  lines  between  cyclic 
and  collective  controls,  but  did  show  a  significant  effect  for  the 
intercept  <y)  between  the  contralateral  and  ipsi lateral  groups. 
However,  there  was  no  difference  between  the  reaction  time  inter — 
cepts  of  the  cyclic  and  collective  controls.  This  indicates  that 
no  matter  what  the  control  or  controlled  plant  dynamics  were,  it 
took  significantly  longer  to  respond  to  the  contralateral  than  the 
ipsilateral  display  case. 

The  ANOVA  results  for  movement  time  (MT)  slopes  (m)  indicated  that 
there  was  the  expected  significant  difference,  between  the  cyclic 
and  collective  controls.  This  result  was  predicted  because  of  the 
difference  in  the  order  of  the  plant  dynamics  of  the  two  controls. 
A  significant  main  effect  was  also  revealed  for  the  slopes  of  the 
MT  for  condition  < i psi 1 ateral /contral ateral >  for  the  cyclic  con¬ 
trol.  This  effect  was  not  found  with  the  collective  control.  The 
analysis  showed  no  differences  between  conditions  or  controls  for 
the  intercepts  (y)  of  the  movement  time  regression  lines.  A 
summary  of  the  results  of  the  MT  analysis  may  be  seen  in  Fig.  7. 
Note  that  though  there  is  no  significant  difference  between  the 
slopes  of  the  collective  control  as  a  function  of  display  condi¬ 
tion,  it  took  more  time  to  meet  the  capture  criterion  with  the 
contralateral  arrangement. 

The  results  of  the  contral  reversal  and  blunder  analysis  can  be 
seen  in  Fig.  8.  These  data  show  that  on  the  average  there  were 
more  control  reversals  in  the  ipsilateral  condition  for  each 
control  than  for  the  corresponding  control  in  the  contralateral 
group.  A  similar  comparison  of  the  occurrence  of  blunders  between 
conditions  produced  the  opposite  result.  There  were  more  blunders 
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in  the  control ateral  condition  -for  both  controls  than  in  the 
ipsi  lateral  arrangement.  There  were  -far  less  blunders  than  rever¬ 
sals  on  the  average  across  subjects. 


DISCUSSION 


BgACIlQN  TIME  RESyUIS: 

The  analysis  o-f  reaction  times  -for  the  two  controls  and  the  two 
display  conditions  supported  the  superiority  o#  the  compatible  S-R 
-arrangement  (ipsi  lateral)  over  -the  contralateral  condition.  This 
is  born  out  by  the  intercept  of  the  regression  lines  but  may  be 
expressed  in  terms  of  the  mean  reaction  times.  In  a  sense,  pure 
response  time  is  a  more  accurate  measure  than  the  intercept  of  a 
regression  line  with  a  slope  of  zero.  Table  2  presents  the  mean 
response  times  in  msec  for  the  eight  subjects  in  each  of  the 
display  conditions  and  for  both  controls.  The  average  subject 
standard  deviation  is  also  included  and  Inspection  of  these  data 
reveals  rather  low  variability,  indicating  that  the  subjects  had 
reached  a  high  level  of  proficiency  with  the  task. 


IPSILATERAL 

CONTRALATERAL 

MEAN  S.O 

MEAN  S.D 

CYCLIC 

348 

15 

430 

19 

COLLECTIVE 

354 

14 

419 

17 

Table  2.  Mean  response  time  and  average 
standard  deviation  (msec)  for  each  display 
group  and  control. 


The  average  difference  in  response  time  between  the  ipsilateral 
and  contralateral  groups  is  approximately  74  msec  when  both  con¬ 
trols  are  considered  together.  An  example  of  the  speed,  altitude 
and  flight  profile  of  a  helicopter  in  a  typical  NOE  mission  will 
help  to  bring  these  results  into  focus. 

Consider  a  helicopter  flying  at  an  altitude  of  three  meters  and  an 
airspeed  of  15.7  m/sec  with  a  rotor  blade  clearance  on  either  side 
of  two  meters.  Under  these  conditions,  and  with  the  existing  PNVS 
contralateral  display  arrangement,  a  pilot  would  be  expected  to 
respond  to  a  commanded  change  in  airspeed  or  altitude  in  425  msec. 
In  this  Interval  of  time,  the  helicopter  would  travel  about  6.65 
meters  (before  the  pilot  responded  with  a  control  action).  The 
Ipsilateral  or  S-R  compatible  arrangement  saves  the  pilot  74  msec 
in  response  time  and  a  distance  traveled  of  1.2  meters.  At  great- 
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•r  altitudss  and  in  the  absence  of  abstacles^  this  advantage  is  of 
little  consequanse  other  than  perhaps  reducing  workload.  At  night 
in  a  NOE  flight,  advantages  associated  with  the  use  o-f  5-R  compat¬ 
ible  instrument-control  arrangements  may  be  critical. 

A  plausible  explanation  for  the  74  msec  superiority  of  the  ipsi la¬ 
teral  over  the  contralateral  arrangement  of  controls  and  instru¬ 
ments  in  this  study  is  the  additional  information  processing  time 
required  to  respond  to  the  incompatible  S-R  condition.  The  litera¬ 
ture  in  support  of  the  superiority  of  reaction  time  performance 
in-  S-R  compatible  systems  is  extensive  and -offers  many  explana¬ 
tions.  The  purpose  of  this  study  was  to  determine  if  there  was  a 
difference  between  the  compatible  and  incompatible  instrument- 
control  relationship.  A  practical  as  well  as  a  statistical  dif¬ 
ference  has  been  revealed  by  the  results  of  this  study. 

OQVgrjgyi  1 1  Mg  RESUUI§: 

The  second  aspect  of  the  overall  task,  moving  the  cursor  to  the 
target  area,  provides  an  opportunity  not  only  to  assess  the  ques¬ 
tion  of  S-R  compatibilty  but  also  to  investigate  the  Fitts  log- 
accuracy  scale  in  a  task  involving  the  complex  and  higher  order 
dynamics  implemented  in  this  study.  The  Fitts  paradigm  was  used  in 
the  design  of  this  experiment  in  order  to  provide  a  systematic  set 
of  increasingly  difficult  tasks  which  the  subjects  were  required 
to  perform.  No  attempt  was  made  to  use  the  information  theoretic 
properties  of  Fitts  Law  in  assessing  performance  with  the  two 
display  groups.  Instead,  the  speed/accuracy  trade  off  imposed  by 
the  index  of  difficulty  of  a  given  task  was  used  to  produce  a 
measureable  time  course  of  control  movement.  A  complete  analysis 
of  Fitts’  Law  is  beyond  the  scope  of  the  current  paper.  However, 
the  rather  high  correlation  coefficients  associated  with  the  re¬ 
gression  analysis  suggest  that  even  for  the  dynamics  as  expressed 
in  equation  (S) ,  the  well  trained  subjects  generated  a  set  of 
movement  times  which  obey  Fitts’  Law. 

The  significant  difference  between  the  slopes  of  the  ipsi lateral 
and  contralateral  groups  for  the  cyclic  control  was  unexpected. 
Had  the  slopes  been  the  same  but  the  lines  offset  in  time,  then  a 
pure  time  delay  could  have  been  posited  much  the  same  as  was 
suggested  in  the  case  of  response  time  measures.  A  significant 
difference  would  have  been  found  in  the  intercepts  of  the  regres¬ 
sion  lines  between  the  two  conditions.  The  analysis  however, 
suggested  that  there  is  both  a  time  and  a  slope  difference.  Close 
inspection  of  Fig.  7  will  lend  some  meaning  to  the  problem  state¬ 
ment.  For  an  ID  of  2.3  there  is  a  600  msec  difference  between 
conditions  whereas  an  ID  of  6.3  produces  a  difference  of  about  1.7 
seconds.  Note  that  the  collective  control  produces  two  parallel 
lines,  offset  in  time,  as  a  function  of  the  display  conditio.. 
This  offset  is  not  a  significant  result  but  it  is  rank  ordered  as 
would  bo  expected  from  the  reaction  time  findings.  Also,  since  the 
plant  dynamics  associated  with  the  two  controls  are  of  different 
order,  one  would  expect  the  cyclic  (the  higher  order  and  more 
difficult  plant)  to  have  a  steeper  slope.  The  fact  that  the 
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6lope«  for  the  two  conditions  are  significantly  different  for  the 
cyclic  control  suggests  that  there  is,  in  a  cognitive  sense,  a 
"different  plant"  being  controlled.  There  is  no  difference  in  the 
dynamics.  Only  the  displays  are  different.  The  effect  seen  might 
be  due  to  a  forced  change  in  control  strategy  between  the  two 
display  conditions.  An  alternate  explanation  is  that  there  is  an 
increase  in  the  time  required  to  effect  control  as  the  difficulty 
of  the  task  (ID)  increases  as  a  result  of  the  S-R  incompatibility. 
That  is,  the  slope  differential  is  about  0.23.  This  is  not  an 
unreasonable  explanation  in  that  increasing  difficulty  may  require 
increasing  information  processing  time.  -  .  .  _  _  _ 

The  results  of  this  study  make  it  clear  that  the  effects  of  S-R 
incompatibility  are  not  limited  to  the  initial  response  phase  of  a 
control  activity.  They  seem  to  propogate  into  the  control  phase  as 
well.  For  the  highest  ID  <6. 3)  there  is  a  1.7  sec  diference  be¬ 
tween  the  ipsi lateral  and  contralateral  conditions.  Siven  the 
conditions  of  NOE  flight  described  above,  in  1.7  seconds  the 
helicopter  would  have  traveled  26.6  meters  farther  with  the  con¬ 
tralateral  condition  before  reaching  the  commanded  control  state 
than  with  the  ipsilateral  display  of  flight  information.  Again, 
the  S-R  compatibility  issue  has  both  practical  and  statistical 
si gni f i cance. 

BiVgBSaU  AND  gUUNDER  RESULISI 

If  one  rank  orders  the  difficulty  of  the  tasks  within  the  experi¬ 
ment,  the  contralateral  display  of  airspeed  controlled  by  the 
cyclic  is  the  most  difficult.  This  is  due  to  the  combination  of 
the  higher  order  cyclic  plant  and  the  contralateral  display  case. 
The  easier  task,  by  the  same  argument,  would  be  the  collective 
control  with  the  ipsilateral  display  case.  Based  on  easier 

dynamics  and  a  less  confusing  display  case,  one  would  predict 
fewer  control  reversals  and  blunders  with  the  collective- 

ipsilateral  tasks.  Although  this  proved  to  be  true  for  control 
blunders  it  was  not  found  in  the  reversal  results.  The  highest 
number  of  reversals  was  associated  with  the  easiest  task; 
collective  with  the  ipsilateral  display  case.  In  fact,  about  34  '/. 
of  the  i psi 1 ateral -col  1 ect 1 ve  trials  were  initated  with  control 
reversals.  Control  reversals  were  detected  on  197.  of  the 
contralateral-collective  trials  averaged  over  all  subjects  in  this 
group.  For  the  cyclic  control,  the  ipsilateral  and  contralateral 
groups  produced  19  and  12%  reversals  respectively  averaged  over 
all  trials  per  session  and  over  subjects  in  each  display  group. 

Since  it  was  not  possible  to  measure  the  difference  between 

response  time  in  the  right  direction  from  response  time  in  the 
wrong  direction,  the  reaction  times  reported  above  are 

contaminated  with  the  reversal  events.  Reaction  times  were 
measured  from  the  presentation  of  the  display  until  a  2% 
deflection  of  the  proper  control  in  the  correct  direction  was 
detected.  Thus,  if  the  reversal  times  were  excluded,  the  response 
times  for  the  ipsilateral  display  cases  would  be  even  less  than 
was  reported.  Because  there  were  fewer  reverals  for  the  contrala- 
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teral  group,  there  would  be  an  even  greater  difference  in  reponse 
times  between  the  two  display  conditions  if  the  reversal  times 
were  removed  from  the  response  times. 

A  possible  explanation  can  be  structured  from  the  increased  infor — 
mation  processing  time  associated  with  the  contralateral  display 
case  as  posited  above  for  the  response  time,  results.  .  If  the 
cdhtralateral  condition  requires  more  time  for  the  subjects  to 
"sort-out"  the  S-R  incompatible  arr»-'>ement  and  response,  then  the 
subject  also  has  more  time  to  n^jrease  the  likelihood  of 
responding  in  the  correct  direction.  With  the  easier  task,  the 
strategy  of  the  subjects  may  have  been  to  respond  and  then  correct 
for  direction.  However,  even  in  the  ipsi 1 ateral -col lect i ve  task 
there  was  a  better-than-chance  probability  (66V.)  that  the  subjects 
would  respond  in  the  correct  direction. 

CONCLUSION 


The  renu’.  ts  of  this  experiment  suggest  the  need  to  reconsider  the 
S-R  compatibility  of  the  instrument  information  displayed  in  the 
PNV8  in  particular  and  in  the  cockpits  of  advanced  technology 
aircraft  in  general.  The  results  of  the  reaction  time  analysis  are 
in  keeping  with  predictions  based  on  the  theory  of  the  superiori¬ 
ty  of  compatible  S-R  arrangements.  The  propogation  of  the  adverse 
contralateral  ef+uct  into  the  control  movement  phase  of  the  cyclic 
task  is  a  compelling  reason  to  attend  to  the  possible  problems  of 
information  transfer  early  in  the  design  of  new  systems. 
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AWARENESS  ON  THE  FINAL  APPROACH 
By 

Lee  H.  Person,  Jr. 

18th  ANNUAL  CONFERENCE  ON  MANUAL  CONTROL 
-  June  8  -  TO,  1982  " 

Dayton,  Ohio 

A  prime  research  objective  of  Langley's  Advanced  Transport  Operating 
Systems  (ATOPS)  program  has  been  the  development  of  electronic  control  and 
display  concepts  which  enhance  a  pilot's  situation  awareness  during  landing 
approaches  In  reduced  weather  minima.  A  basic  philosophy  has  been  to  pro¬ 
vide  the  pilot  situation  and  predictive  Information,  In  a  simple  Integrated 
format,  and  de-enphasize  the  coinnand  type  Information  associated  with  current 
flight  directors.  Additionally,  a  philosophy  which  keeps  the  pilot  In  the 
decision  making  and  action  role  has  been  strongly  maintained. 

This  talk  traces  a  segment  of  the  ATOPS  research  which  retains  the 
pilot  In  the  control  loop  as  an  active  component  of  an  electronic  aircraft 
system  where  precise  navigation  solutions,  control  augmentation,  and 
electronic  display  concepts  have  been  Integrated  to  increase  situation  aware¬ 
ness  and  reduce  workload.  It  focuses  on  the  development  of  information 
requirements  for  a  Primary  Flight  Display  (PFD)  to  complement  an  augmented 
manual  flight  control  mode  which  allows  the  pilot  direct  control  of  the 
orientation  of  the  aircraft  velocity  vector. 
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ABSTRACT 


i  Electrocutaneous  stimulation  using  electric  pulse  trains  is  one  of  the 

j  most  effective  cutaneous  displays  for  tactual  coiaiminlcation  systems.  This 

i  paper  deals  with  the  human  operator's  characteristics  in  compensatory  manual 

:  tracking  system  including  electrocutaneous  display.  Firstly,  an  electro- 

j  cutaneous  manual  con^nsatory  tracking  system^ich  consists  of  a  remdom  ^  - 

I  noise  generator,  a  low-pass  filter,  a  mviltichahnel  stimulator,  a  stimulus  _ 

pulse  energy  controller,  an  isolator  and  a  computer ^as  cons tructed.~  Secondly, 
’  hxanan  operator's  characteristics  under  several  para^ter  situations  in  a 

]  compensatory  tracking  syst,em  (i.e. ,  display  transformation  method,  display 

gain,  and  pulse  frequency/^iwW^evaluated  from  Root  Mean  Square  values  (RMS) 
i  of  control  errors  and  transfer  functions  of  human  operators.  Thirdly, 

I  differences  between  human  operator's  control  performance  in  various  cutaneous 

^  Md  visual  tracking  displays  were  discussed.  As  a  result,  the  optimal 

condition  for  an  electrocutaneous  display  in  a  tracking  control  system  was 
I  presented  and  human  operator's  control  performance  in  electrocuteuieous  manual 

I  tracking  system  was  found  to  be  as  good  as  that  in  vibro-tactile  though 

I  inferior  to  that  in  visual. 

I 

INTRODUCTION 


4'  1*^ 


^  Several  previous  investigations  have  been  concerned  with  hisnan  performance 

I  in  conpensatory  numual  tracking  tasks  (1],[2],(31.  Compensatory  tracking  has 

been  proved  a  useful  tool  for  research  into  the  characteristics  of  the  human 
operator  in  man-machine  systems.  Most  experiments  have  used  a  continuous 
visual  display  for  indicating  the  magnitude  and  direction  of  the  tracking 


*)  He  is  a  Visiting  Scholar  at  the  Biotechnology  Laboratory  of  UCLA,  L.A.,  CA 
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error [1].  Tactile  displays  offer  the  possibility  of  analogous  one  dimensional 
and  spatial  displays.  Several  investigators  have  proved  that  tactile  displays 
can  be  used  successfully  to  construct  an  effective  sensory  substitution  system 
for  prosthetic  limbs,  sensory  prostheses  and  so  on{4] , [5] , [6] , [7] . 

Stimulation  of  tactile  sense  can  be  accomplished  with  electrical, 
mechanical,  thermal,  and  chemical  stimuli.  It  has  been  established  that  the 
most  practical  method  for  communication  purposes  is  the  mechanical  and 
electrical.  Investigators  that  have  experimented  with  tactile  tracking 
Include  Durr [8] ,  .Geldard[10] ,  Hirsch  and  Kadushinlll] ,  Howell  eutd  Briggs (12] , 
Weissenberger  and  Sheridan[13] ,  Seely  and  Blis8(14],  Alles[15],  and  Hill[16]. 
Most  of  this  research  is  concerned  with  tactile  tracking  with  mechanical  or 
vibro-tactile  stimuli.  Investigations  concerning  with  m£mual  tracking  with 
electrocutaneous  feedback  has  been  carried  out  by  Szeto[17],  Schmid  and  Bekey 
[18],  and  Anani  ^md  Kdmer[19].  Szeto  proposed  seven  kinds  of  electrode  tactual 
codes  and  evaluated  the  effectiveness  of  them  from  RMS  value  of  control  error. 
Schmid  et  al.  used  a  two  dimensional  electrocutaneous  display  to  estimate  the 
behavior  of  the  spinal  cord  injury  handicapped  from  the  tramsfer  function 
of  the  human  operator  in  tracking  tasks.  Anani  et  al.  studied  hunum  operator 
performance  in  tracking  system  including  an  afferent  electrical  nerve 
stimulation.  Though  researchers  Indicated  above  have  actively  investigated 
manual  tracking  tasks  with  electrocutaneous  feedback,  there  has  been  little 
research  on  compensatory  tracking  tasks. 

In  general,  human  operator  behavior  in  manual  tracking  tasks  depends  on 
various  tracking  system  parameters  -  the  type  of  command  signal,  command 
signal  bandwidth,  display  gain,  closed  loop  gain,  the  type  of  display 
transformation  and  controlled  element  dynamics [20] .  Manual  tracking 
experiments  in  the  past  involve  varying  these  parameters.  The  present  reseaurch 
emphasized  varying  the  type  of  display  transformation  and  stimulus  pulse 
parameters  as  well  as  other  classical  parameters,  display  gain  and  comnumd 
signal  bandwidth.  From  this  approach,  it  should  be  possible  to  find  the 
optimal  stimulus  condition  in  manual  tracking  tasks  with  electrocutaneous 
feedback.  The  difference  between  electrocutaneous  stimulation  and  other 
display  modalities  will  also  be  investigated. 


INSTRUMENTATION 


Electrocutaneous  cooanunication  can  be  accomplished  with  several  stimulus 
waves  and  information  transmission  codes.  However,  pulse  stimulation  is 
usually  chosen  with  the  information  codes,  magnitude,  pitch  and  location  of 
the  perceived  pulse  stimulus.  In  this  series  of  experiments,  meignitude  wd 
pitch  of  pulse  stimulus  were  chosen  as  information  codes.  The  use  of  those 
codes  are  important  for  constructing  a  simple  electrocutaneous  communication 
system  since  it  allows  to  build  the  system  under  the  use  of  less  electrodes, 
though  location  code  can  transmit  a  larger  amount  of  information. 

Fig.  1  shows  the  experimental  setup  used.  The  experiment  system  includes 
a  computer (POP  11/40),  multichannel  simultaneous  stimulator,  stimulus  energy 
controller.  Isolator,  electrodes,  low-pass  filter  with  nitof?  frequency 
adjustedile,  random  noise  generator  and  joystick.  The  output  of  stimulator  was 
isolated  by  the  photo-coupling  type  isolator  and  was  presented  on  to  the  skin 
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of  a  subject  via  two  sets  of  wet  electrodes.  The  two  sets  of  electrodes 
were  placed  on  the  skin  above  the  biceps  brachlKFlg.  1).  Two  electrode  sites 
were  located  100  nun  apart  along  the  longitudinal  axis  of  the  biceps  brachli. 

At  each  site  were  three  electrodes  placed  20  nsn  apart  perpendicularly  to  the 
muscle's  length.  The  two  outer  electrodes  at  each  site  were  connected  2Uid 
used  as  a  common,  and  negative  pulses  were  applied  to  each  central  electrode. 

In  previous  paper  the  authors  reported  that  the  magnitude  sensation  of 
electrocutaneous-stimulatlon  was  strongly  related  to  the  stimulus  pulse 
energy [21].  For  this  reason,  stimulus  pulse  energy  and  frequency  were  used  as 
stimulus  parameters  relevwt  to  magnitude  and  pitch  codes  in  electrocutaneous 
Information,  respectively. 

The  ytask  of  the  sid^ject  In  this  experiment  Is  to  eliminate  tracking  error 
by  Kuinually  adjusting  a  joystick  in  response  to  command  signals.  The  comnumd 
signal  to  the  system  is  white  noise  through  a  low-pass  filter.  Movement  of 
joystick,  which  consists  of  a  dial  and  potentiometer,  produced  an  analog 
voltage  output  proportional  to  the  disp^acement  from  the  center  position. 

Error  signals,  the  voltage  difference  between  command  and  joystick  output, 
were  calculated  using  operational  amplifiers.  After  the  detection  of  the  error 
signals,  they  were  san^led  at  the  rate  equal  to  pulse  rate  of  stimulation  used. 
These  sampled  error  signals  were  put  into  computer  via  analog-to-digital 
converter  £uid  used  to  modify  pulse  parameters.  Pulse  energy  and  pulse  frequency 
of  stimulus  were  varied  according  to  the  sampled  tracking  error  signals.  The 
electrode  site  near  the  shoulder  was  stimulated  when  tracking  error  was 
pos^itive,  and  electrode  site  near  the  elbow  was  stimulated  when  tracking 
error  was  negative.  The  selection  of  stimulus  sites  according  to  the  direction 
of  tracking  error  was  performed  using  computer  controlled  relay  device. 

A  computer  controlled  multichannel  simultaneous  stimulator  was  used  to 
produce  stimulus  pulse  trains  with  appropriate  parameters  corresponding  to 
seunpled  tracking  error  signals.  The  energy  of  each  pulse  was  regulated  by  a 
stimulus  energy  controller  associated  with  constant  current  isolator.  The 
details  of  multichannel  stimulator  and  stimulus  energy  controller  have  been 
described  in  ether  papers [22] , [23] ,  [24] . 

Throughout  the  experiment,  the  dynamics  of  the  joystick  were  kept  constant. 
The  stroke  of  joystick  movement  was  about  90  degrees  in  each  of  clockwise  and 
counterclockwise  directions  from  the  center  position.  As  a  controlled  element, 
position  vechicle  was  used. 

Subjects  were  researchers  of  experience.  One  of  them  performed  all  of 
experimental  tasks.  The  results  for  the  subject  are  shown  in  the  following 
sessions. 


EVALUATION  OF  THE  MAGNITUDE  CODE 


The  magnitude  code  information  will  be  transmitted  to  a  subject  inter¬ 
mittently,  when  pulse  stimulation  is  used.  Human  operator  performance  in  this 
manual  control  system  with  magnitude  code  electrocutaneous  feedback  is 
considered  to  depend  on  the  pulse  frequency  of  stimulation  used.  The  use  of 
pulse  stimulation  with  long  pulse  interval  may  cause  the  decrease  of  human 
operator  controlled>ility  because  of  the  decrease  of  transmitted  feedback 
Information  per  unit  time. 
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The  first  experiment  was  conducted  to  investigate  the  relation  between 
human  operator  controllability  wd  pulse  frequency.  In  the  second  experiment, 
human  operator  behavior  in  a  manual  tracking  task  with  several  system 
parameters  were  measured  under  the  use  of  the  optimum  stimulus  frequency 
estimated  from  the  first  experiment. 

EXPERIMENT  I - VARYING  STIMULUS  PULSE  FREQUEMCY 

METHOD  -  -  -  -  - - - 
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Pulse  frequency  and  bandwidth  of  the  consiand  signal  were  varied.  Six  or 
seven  kinds  of  pulse  frequencies  in  the  remge  from  10  pps  to  100  pps,  and 
white  noise  connand  band-limited  at  0.1,  0.2,  0.4,  0.5  and  0.8  Hz,  which 
show  cutoff  frequencies  of  low-pass  filter (Pc) »  were  used.  A  subject  was 
required  to  perform  compensatory  tracking  tasks  to  each  of  those  command 
signals,  perceiving  electrocutaneous  feedback  with  each  of  those  pulse 
frequency  stimulations.  Pulse  energy  of  stimulus  was  varied  proportionally 
according  to  the  increase  of  tracking  errors  in  the  remge  from  minimum 
threshold  to  maximum  threshold.  The  display  transformation  is  shown  in 
Fig.  3(a). 

Each  trial  in  this  tracking  experiment  was  3.5  minuite  long.  The  trials 
were  performed  after  the  subject  had  familiarized  himself  with  experimental 
apparatus  and  procedures.  Tracking  errors  were  recorded  into  a  data  recorder 
(TEAC  260) .  The  data  playbacked  were  transferred  into  the  memory  of  computer. 
Tracking  errors  were  squared  and  integrated  in  the  computer  in  order  to  get 
the  RMS  values.  A  RMS  value  of  tracking  error  was  normalized  by  a  RMS  Value 
of  coumand  signal.  The  normalized  RMS  values  of  tracking  errors  were  used  as 
a  final  human  operator  performamce  measure  in  this  experiment. 

RESULTS  AND  DISCUSSIONS 


Fig.  2  shows  the  subject's  normalized  RMS  value  as  a  function  of  stimulus 
pulse  interval.  Each  curve  in  the  flgxire  corresponds  to  tlie  experimental 
results  with  each  bandwidth  of  command  signal  used.  As  shown  in  Fig.  2,  the 
trial  for  Fc*0.8  Hz  was  performed  only  under  the  use  of  stimulations  with 
pulse  intervals  less  than  50  ms,  because  it  was  difficult  for  a  subject  to 
track  the  command  signal  when  stimulations  with  pulse  intervals  larger  than 
50  ms  were  used.  From  the  inspection  of  the  experimental  results,  it  is 
found  out  that  (a)  the  smaller  both  of  pulse  interval  of  stimulation  and 
bandwidth  of  comnand  signal  are,  the  bettor  the  compensatory  tracking  scores 
are,  and  (b)  the  decreasing  rates  of  RMS  scores  Increase  according  to  the 
increase  of  bcuidwidth  of  command  signal,  especially  when  the  stimulations 
with  pulse  intervals  larger  than  50  ms  are  used. 

One  possible  interpretation  of  those  results  may  be  related  to  how  long 
the  human  operator  can  persist  in  each  of  the  magnitude  sensations  evoked 
intermittently  by  pulse  stimulation.  A  second  possible  interpretation  may  be 
related  to  the  decrease  of  directional  information  of  tracking  errors  under 
the  use  of  stimulations  with  long  pulse  intervals.  The  subject  suggested 
that  the  latter  interpretation  was  valid. 

To  investigate  this  problem,  brief  experiments  were  performed.  The 
experimental  procedure  was  the  same  as  experiment  I  except  that  the 
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experimental  system  contained  an  additional  visual  display  for  exact 
presentation  of  directional  information  of  tracking  error  by  means  of  LED 
(light  emitting  diode) .  The  results  of  the  experiment  indicated  that  the 
tracking  scores  under  the  use  of  atimulation  with  100  ms  pulse  interval  in 
this  experiment  became  approximately  equal  to  those  with  10  ms  pulse 
intervals  in  the  previous  experiment,  while  those  under  the  use  of  stimulation 
with  10  ms  pulse  interval  were  not  improved.  From  th2  results,  it  can  be 
concluded  that  in  order  to  keep  good  operator  performance  stimulations  with 
pulse  intervals  less-theui  20  ms  should  be  used, -and  em  establishment  of  exact 
directional  information  display  is  important  in  a  tracking  experiment  with 
the  use  of  long  pulse  interval. 

In  the  following  experiments  associated  with  magnitude  code  stimulation, 

10  ms  pulse  interval  was  used. 

EXPERIMENT  II - VARYING  SYSTEM  PARAMETERS 

METHOD 

Human  performance  in  the  tracking  system  with  different  transformations 
and  display  gains  were  compared  in  each  experiment.  In  this  experiment 
display  transformation  was  varied  to  compare  the  linear  and  threshold 
transformation  shown  in  Fig.  3.  In  the  linear  transformation,  pulse  energy  of 
stimulation  varied  proportionally  according  to  instantaneous  tracking  error. 

In  the  threshold  transformation,  pulse  energy  of  stimulation  was  turned  to 
an  appropriate  energy  level  from  the  minimum  sensation  threshold,  when  an 
instantaneous  tracking  error  became  more  than  a  specified  value.  The  linear 
transformation  was  tested  at  several  different  display  gains,  and  the 
threshold  transformation  was  done  at  several  dead  bands.  Each  of  those 
experiments  was  performed  at  three  different  bandwidths  of  command  signals. 
Tracking  tasks  were  same  as  those  in  the  previous  experiments.  A  normalized  RMS 
value  of  the  tracking  error  and  a  human  operator  transfer  function  were  used 
as  human  performance  measures.  Firstly,  the  normalized  RMS  values  were 
computed  for  each  trial,  and  a  gain  which  indicated  the  best  RMS  score  was 
chosen  for  each  beuidwidth  of  command  signal  in  each  transformation.  After 
those  investigation,  another  experiment  was  performed  at  the  best  gain  in 
order  to  estimate  the  human  operator  performance  from  the  transfer  function. 

In  the  experiments  associated  with  RMS  score  and  transfer  function,  a  subject 
had  one  and  three  3.5  minuite  tracking  trials  for  each  parameter  situation, 
respectively.  Three  kinds  of  variable,  tracking  errors (e),  band-limited 
command  signal (r)  and  operator  output  signals (u),  were  recorded  into  a  data 
recorder  for  each  trial.  It  should  be  noted  that  the  operator  output  was 
equal  to  control  value  because  tracking  system  used  in  the  experiments  had  an 
unity  controlled  element. 

Performance  measures  were  evaluated  from  the  recorded  data  using  a  digital 
computer  as  mentioned  in  the  above  session. 

RESULTS  AND  DISCUSSIONS 

Fig.  4(a)  shows  the  relation  between  the  normalized  RMS  of  the  tracking 
error  and  the  display  gain  for  the  linear  transformation.  Fig.  4(b)  shows  the 
relation  between  the  normalized  RMS  of  the  tracking  error  and  the  normalized 
dead  band  for  the  threshold  transformation.  Each  curve  in  both  figures 
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corresponds  to  the  result  of  each  bandwidth  of  command  signal  used.  The 
principal  features  of  the  results  are  as  follows:  (1)  For  the  linear 
transformation,  each  set  of  trials  shows  the  RMS  of  tracking  error  decreases 
when  display  gain  increases.  The  RMS  score  has  a  tendency  to  keep  relatively 
constant  at  higher  display  gain.  (2)  For  the  threshold  transformation,  each 
set  of  trials  shows  the  RMS  of  tracking  error  has  U-shaped  characteristics 
with  varying  dead  band.  (3)  RMS  scores  of  tracking  tasks  for  the  linear 
treuisformation  are  superior  to  those  for  the  threshold  transformation. 

The  above  result (1)  suggests  that  human  operator  performance  in  tracking 
tasks  with  magnitude  code  electrocutweous  feedback  will  not  be  effected  by 
adaption  of  the  receptor  iinder  the  skin.  This  is  usually  observed  in  tactual 
ccmsnunication  systems  and  causes  temporal  decrease  of  display  gain  during  the 
tracking  task.  The  difference  between  the  results  for  the  linear  and  threshold 
transformation  indicates  that  it  is  important  to  display  the  magnitude 
infonnation  of  tracking  error  as  well  as  the  directional  information  in  order 
to  keep  good  operator  performance.  The  decrease  of  RMS  score  at  lower  dead 
band  in  the  threshold  transformation  has  much  to  do  with  instability  of  the 
system  caused  by  a  large  equivalent  closed  loop  gain.  The  decrease  at  larger 
dead  batnd  is  considered  to  relate  to  the  decrease  of  display  information 
accuracy. 

Transfer  functions  are  estimated  from  the  following  equation, 

Vh  =  FRU<jw)/FRE  (jw) 

where  Yhs  human  operator  transfer  function,  Fpufjw);  cross-power  spectral 
density  of  closed  system  input  and  system  output,  PRE(jw):  cross-power 
spectral  density  of  closed  system  input  and  tracking  error. 

The  two  cross-power  spectral  densities  were  calculated,  utilizing  a 
standard  Past  Fourier  Transformation  program (FFT)  in  the  computer.  For  FPT 
analysis,  analog  data  in  data  recorder  were  digitized  at  10  Hz  rate.  Proper 
precautions  were  taken  to  reduce  aliasing  due  to  sampling  by  appropriately 
filtering  the  data  at  each  step  of  the  operation.  FFT  were  performed  for 
500  sections  of  512  points  overlapped  by  one  point  with  a  sampling  frequency 
of  10  Hz.  Each  cross-power  spectral  density  for  each  parameter  situation  was 
obtained  from  the  average  across  all  of  the  FFT  results.  Fig.  5  shows  human 
operator  tremsfer  functions.  These  are  results  for  bandwidths  0.3  Hz,  0.5  Hz 
and  0.8  Hz  at  display  gain  53  erg/volts  and  normalized  dead  band  0.5,  which 
Indicated  optimum  operator  performance  in  previous  experiments.  Both  operator 
gain  <md  phase  shift  are  plotted.  The  main  difference  between  the  curves 
is  their  varying  gain.  The  difference  is  greater  under  the  use  of  a  command 
signal  which  includes  higher  frequency  components.  The  increase  of  command 
signal  bandwidth  causes  the  reduction  of  operator  gain.  In  general,  it  is 
well-known  that  human  operator  gain  decreases  in  a  manual  tracking  control 
system  with  visual  feedback  when  he  has  command  signals  which  include  higher 
frequency  components.  This  is  because  he  must  attend  to  the  whole  frequency 
components  which  are  Included  in  the  command  signal.  Hence,  he  cannot  keep 
the  operator  gain  constant.  The  experimental  results  are  interprered  in  the 
same  way. 

The  difference  between  the  linear  and  threshold  transformation  is  not  so 
significant  under  the  use  of  command  signal  band-limited  at  0.3  Hz.  The 
operator  gain  characteristics  for  the  linear  transformation  is  evidently 
superior  to  that  for  the  threshold  transformation  under  the  use  of  coimand 


signals  which  are  band-limited  at  larger  frequency,  that  is,  0.5  Hz  and  0.8  Hz. 


EVALUATION  OF  THE  PITCH  CODE 


METHOD 

One  tjpe  of  “display  transforation"  was  used  in  this  experiment  (Fig.  3  (c) ) . 
The  pulse  Interval  of  stimulation  was  proportionally  varied  according  to 
tracking  errors  as  shown  in  the  figure.  The  range  of  pulse  interval  was 
from  10  ms  to  100  ms,  because  it  is  well-known  that  the  operator  has  excellent 
frequency  discrininability  in  this  range [25].  Minimum  level  of  pulse  interval 
was  fixed  at  10  ms.  The  experiments  were  broken  into  two  parts  as  well  as  the 
previous  experiments.  In  the  first  experiment,  the  RMS  score  of  tracking  task 
was  determined  with  varied  display  gain.  In  the  next  experiment,  human  operator 
performance  was  evaliiated  using  human  operator  transfer  functions  with  the  use 
of  the  display  gain  at  which  an  operator  showed  an  optimum  RMS  score  in  the 
tracking  task.  The  experimental  procedures  and  the  processing  method  of 
experimental  results  were  identical  to  the  previous  experiment.  Energy  of 
stimulation  pulse  was  set  at  a  comfortable  level  for  a  subject. 

RESULTS  AND  DISCUSSIONS 

Fig.  6  shows  the  normalized  RMS  scores  of  tracking  errors  for  various 
display  gains.  Bandwidth  of  coimnand  signal  employed  was  from  DC  to  0.3  Hz. 
Energy  of  stimulation  pulse  was  42.4  erg. 

The  results  indicate  that  (i)  the  RMS  scores  vs.  display  gain  shows 
U-shaped  characteristics  and  (ii)  the  RMS  scores  are  inferior  to  those  for 
the  magnitude  code.  The  reason  for  the  decrease  of  RMS  score  at  lower  display 
gains  may  be  explained  by  the  fact  that  the  subjects  must  recognize  the 
tracking  error  through  stimulation  with  longer  pulse  intervals  at  those  gains. 
In  a  tracking  task  with  higher  display  gain,  operator  will  use  frequency 
ranges  with  a  larger  just  noticeable  difference  more  often  to  recognize  the 
tracking  error.  It  is  considered  to  be  reason  why  RMS  scores  at  higher  display 
gain  decrease. 

Fig.  7  shows  human  operator  transfer  functions,  which  includes  the 
results  for  command  signals  band-limited  at  0.3  Hz,  0.5  Hz  and  0.8  Hz.  The 
display  gain  was  300  ms/volts,  which  was  the  optimum  gain  in  above  experimental 
results.  From  the  inspection  of  the  results,  it  is  found  that  the  operator 
gain  with  pitch  code  communication  has  a  tendency  to  decrease  much  more  than 
with  magnitude  code  communication,  when  command  signal  with  higher  frequency 
component  is  used.  The  human  operator  behavior  for  pitch  code  communication, 
however,  is  apploximately  same  to  that  for  magnitude  code  communication. 

The  facts  imply  that  a  subject  has  an  inadequate  adaptability  for  the  change 
of  comnand  signal  bandwidth  in  a  tracking  task  with  pitch  code  stimulation. 

The  reduction  of  operator  gain  under  the  use  of  command  signal  with  higher 
frequency  components  may  be  related  to  information  display  mechanisms  of  pitch 
code  communication.  When  using  pitch  code  coinnunication ,  information  display 
rate  will  be  varied  according  to  the  magnitude  of  tracking  error.  With  display 
transformation  in  Fig.  5,  information  display  rates  decrease  when  tracking 
error  go  to  zero.  Such  a  decrease  of  information  rate  may  cause  a  reduction 


of  operator  controllability,  because  it  made  it  difficult  for  a  subject  to 
track  the  wide  bandwidth  command  signal  with  high  accuracy. 


COMPARISON  OF  ELBCTROCOTANEOUS  DISPLAYS 


Considering  the  electrocutaneous  displays  tested  in  these  experiments, 
the  best  is  estimated  to  be  the  linear  transformation  using  the  mgriitude 
-code.  The-next-best  'is-the  threshold  tranafomat ion  using  the  magnitude  code 
or  the  linear  transformation  using  the  pitch  code.  In  order  to  coiqpare  these 
electrocutaneous  displays  with  each  other,  auid  with  typical  visual  and  vibro- 
tactlle  displays  performance,  the  equivalent  gain  and  time-delay  parameters 
for  the  displays  were  computed,  employing  the  method  which  was  proposed  by 
Hill [16].  The  following  equation,  which  Is  a  kind  of  extended  crossover 
model  was  used  in  order  to  determine  the  parameters. 
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where  K  is  the  equivalent  gain,  t  is  the  equivalent  time-delay,  and  v/2  Is 
phase-lag  constant  coefficient,  which  is  needed  to  get  the  better  fit  to  data 
at  low  frequency  vdien  a  corssover  model  is  applied  to  a  manual  tracking  system 
with  position  vehicle.  For  vibrotactile  displays,  the  data  of  Bliss [9],  which 
were  obtained  from  tracking  trials  using  tactile  contact  and  tactile  air  jet 
displays,  were  used.  The  data  of  Elkind,  McRuer,  Bliss  and  the  authors  were 
used  for  visual  displays.  All  of  data  were  obtained  with  a  position  vehicle. 

The  authors'  visual  and  electrocutaneous  display  data,  and  Bliss's  visual  and 
tactile  contact  data  were  the  results  from  one  subject.  To  compare  two 
parameters  K,  t,  associated  with  the  electrocutaneous  display,  the  results 
which  were  best  fitted  with  the  crossover  model  parameters  were  chosen  for 
each  display  transformation.  Those  results  associated  with  ■  0.5  Hz  (linear), 
=  0.3  Hz  (threshold)  and  =  0.3  Hz  (frequency).  Fig.  8  shows  the  equiva¬ 
lent  gain  and  time  delay  parameters  for  position  vehicle  plotted  on  the  K-x 
plane  with  equal  phase  margin  curves,  calculated  using  the  following  equation. 


ff-[(KT+(Tr/2))-(Tr/2)]  -  a 


where  a  is  phase  margin. 

It  ceui  be  seen  in  Fig.  8  that  performance  obtained  with  each  tramsformation 
of  electrocutaneous  displays  is  consistently  ordered  from  the  worst  to  the 
best  —  threshold,  frequency  and  linear.  In  the  recent  practical  application 
of  electrocutctneous  communication,  only  the  pitch  code  has  been  utilized.  It 
should  be  noticed  that  the  results  indicated  that  the  magnitude  code  was 
most  io^rtant  in  a  compensatory  manual  tracking  system.  The  electrocutemeous 
displays  yield  less  gain  emd  greater  time-delays  than  the  other  displays 
except  tactile  air  jet.  Some  care,  however,  must  be  exercised  when  the  results 
of  Bliss  are  Interpreted,  as  Hill  suggested [16] .  The  subject  is  a  man  of  quite 
excellent  tracking  ability  and  his  visual  gain  is  much  higher  than  McRuer  and 
Elkind 's  average  data.  The  gains  on  both  his  tactile  and  visual  trials  should 
be  scaled  down  about  30  percent  to  match  that  of  the  average  subject.  The 
results  in  the  present  research  is  considered  to  provide  the  data  of  the 
average  subject,  because  the  subject's  visual  gain  euid  time-delay  approximately 


are  equal  to  McRuer  and  Elklnd's  average  data,  as  shovm  in  Fig.  8.  If  the 
above  mentioned  modification  for  the  data  of  Bliss  is  done,  the  electrocutaneous 
linear  transformation  with  magnitude  code  offer  performance  fairly  coitparable 
to  that  obtained  with  tactile  contact  display  of  Bliss,  though  it  is  still 
poorer  than  visual  display. 


CONCLUSIONS 


The  feasibility  of  electrocutaneous  displays  in  con^nsatory  numual 
tracking  has  been  demonstrated.  Three  kinds  of  electrocutaneous  displays, 
linear  transformation,  threshold  trems formation  using  magnitude  codes,  and 
linear  transformation  using  pitch  code,  have  been  investigated  under  the 
best  stimulus  conditions. 

The  results  of  transfer  function  analysis  indicated  that  the  electro¬ 
cutaneous  display  was  most  effective  with  linear  transformation  using  magnitude 
code  and  least  effective  with  threshold  transformation. 

When  conq^ared  with  other  displays,  performance  for  linear  trwsformation 
using  magnitude  code  was  approximately  equivalent  to  that  for  tactile  contact 
display.  However,  equivalent  gain  was  less  emd  equivalent  time  delay  was  longer 
for  electrocutaneous  display  than  for  visual  display. 
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Fig.  4  Relation  between 
Display  Gain  or 
Dead  Band  and 
Normalized  RMS 
Value  of  Control 
Error  (Pit  Pulse 
Interval,  Pc: 
Cutoff  Frequency 
of  Low-Pass  Filter 
Used  to  Limit  the 
Bandwidth  of 
Connnand  Signals)  . 
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Fig.  6  Relation  between  Display  Gain  and  Normalized 
RMS  Value  of  Control  Error  under  the  Use  of 
Frequency  Transformation (Pc:  Cutoff  Frequency 
of  Low-Pass  Filter  Used  to  Limit  the  Bandwidth 
of  Command  Signals,  PE;  Stimulus  Pulse  Energy). 
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Equivalent  Gain 


Equivalent  Time  Delay  T  sec 


Fig.  8  Comparison  of  Displays (EST:  Electrocutaneous 

Stimulation,  Mag  Mod(L):  Linear  Tremsformation 
Using  Magnitude  Code,  Freq  Mod:  Frequency 
Treuisformatlon,  Mag  Mod(T):  Threshold  Trans¬ 
formation  Using  Magnitude  Code,  /2/,/3/,/9/: 
Indicate  the  Numbers  of  References) . 
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ABSTRACT  -  _  . 

An  approach  is  presented  wiiich  transfornns  a  dynamic  articulated,  col 
lision*prone  machine^such  as  a  remote  manipulator  or  robotjinto  a  static 
multidimensional  representatic .1  of  its  collision  possibilities.  Among  other 
advantages  of  this  approach,  the  basic  problem  of  finding  collision  free  and 
optimized  machine  movements  from  an.  initial  to  a  final  configuration  be¬ 
comes  immediately  clear  and  conceptually  solvable.  The  major  disadvan¬ 
tages  of  the  approach  at  this  point  appear  to  be  related  to  computational 
procedures  and  data  storage.  However,  the  clarification  of  the  control  and 
guidance  problem  gained  through  the  transformational  approach  as  well  as 
its  elucidation  of  many  related  problems  remain  prime  conceptual  tools. 

This  paper  presents  a  number  of  aspects  of  this  approach  as  well  as  several 
simplified  examples .  s/' 

INTRODUCTION 


Partial  or  fully  automated,  flexible  computer  control  of  maltidegree  of 
freedom  structures  such  as  robots,  remote  manipulators,  numerically  con¬ 
trolled  machines,  or  other  articulated  structures  faces  two  basic  problems. 

(1)  The  automatic  determination  of  an  integrated  course  of  movement 
(trajectory)  of  each  degree  of  freedom  such  that  the  change  from  machine 
configuration  A  to  configuration  B  (e.g.  initial  to  final  configuration)  can 
proceed  in  some  optimal  fashion  without  the  machine  structures  or  pieces 
undesirably  colliding  with  each  other  or  with  surrounding  structures, 

(2)  Execution  of  or  movement  control  along  the  integrated  trajectory 
with  a  precision  sufficient  to  ensure  achievement  of  the  goal  while  nnaintain- 
ing  acceptable  safe  tolerances  from  possible  collisions. 

There  are  four  distinct  direct  approaches  to  the  solution  of  these 
problems. 

1.  The  artificial  intelligence  approach  would  try  to  emulate  "intelli¬ 
gent"  behavior  by  equipping  the  structure  with  sensors  for  proximity,  vision, 
etc.  and  algorithms  intended  to  allow  the  machine  to  find  its  way  safely 
from  A  to  B. 

2.  The  repertoire  approach  uses  preprogramn.ing  of  all  possible  move 
ments  that  may  be  required  and  executes  these  as  needed  as  in  automated 
assembly. 
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3.  Model  mimic  techniques  use  a  faithful  geometric  computer  model 
of  the  machine  which  can  be  moved  according  to  an  ad  hoc  trial  plan  with 
collision  possibilities  predetected  by  checking  the  position  of  the  model 
machine's  structures  at  points  along  the  trajectory.  A  collision  free  check 
would  imply  an  acceptable  trajectory. 

4.  The  transformational  approach  maps  all  of  the  collision  possibilities 
of  the  dynamic  three  dimensional  geometric  machine  with  its  infinity  of  con¬ 
figurations  into  a  set  of  finite  zones  within  a  static  hyperdimensional  config¬ 
uration  space.  Any  possible  machine  configuration  is  a  point  (vector)  in  this 
configuration  space  and  any  machine  movement  no  matter  how  dynamically 

or  spatially  complex  is  a  point  trajectory  in  this  space.  Finding  optimal  and 
collision  free  machine  movement  corresponds  to  finding  trajectories  through 
only  the  collision  free  areas. 

Each  of  the  above  methods  has  its  own  advantage  and  disadvantages. 

The  artificial  intelligence  approach  puts  considerable  premium  on  the  inven¬ 
tion  of  sensors  and  heuristic  algorithms  but  lacks  a  systematic  interpretation 
and  approach  to  the  general  problem.  Neither  does  it  ojffer  a  methodology 
for  designing  dynamic  articulated  structures  so  as  to  reduce  collision 
proneness . 

The  repertoire  technique  is  pragmatic  and  practical  and  gets  specific 
jobs  done.  It  is  best  suited  to  repetitive,  fixed  movements  although  there 
is  some  capabilities  for  syntheiuzing  new  movements  from  existing  elements. 
However,  it  suffers  the  same  drawbacks  as  given  above  for  the  artificial 
intelligence  approach. 

The  model  mimic  technique  is  a  feasible  approach  whose  main  drawbacks 
are  that  (1)  by  itself  it  does  not  offer  any  methodology  for  automatic  determin¬ 
ation  of  collision  free  trajectories  and  (2)  point -by-point  prechecking  of  a 
trajectory  becomes  increasingly  time  consuming  as  the  required  probability 
of  not  detecting  an  impending  collision  diminishes  to  zero.  As  with  the  pre¬ 
vious  two  approaches,  this  technique  does  not  provide  a  general  understand¬ 
ing  of  the  problem  nor  offer  guidance  to  the  design  of  less  collision  prone 
machines. 

The  transformational  approach  has  the  drawback  that  it  is  computation¬ 
ally  challanging  at  present  and  the  result  may  suffer  from  lack  of  visualiza¬ 
tion.  It  trades  a  three  dimensional  visually  recognizable  but  movement  com¬ 
plex  dynamic  structure  for  a  conceptually  simple  and  static  but  hyperdimen- 
sional  construct.  It  is  similar  in  this  respect  to  linear  programming  which 
transforms  a  lower  dimensional  problem  of  inequalities  into  a  higher  dimen¬ 
sional  one  of  equalities  for  the  sake  of  a  uniforr  solution  methodology  and 
provides  deeper  insights  into  the  original  pr./blem.  The  major  advantages 
of  the  transformation  approach  include  a  unified  framework  ^or  representing 
and  solving  the  problem  of  the  automated  determination  of  optimal  collision 
free  machine  movements.  It  also  offers  the  potential  for  performing  a  re¬ 
verse  transformation  for  designing  a  machine  of  reduced  collision  proneness. 
Furf:her  advantages  include  the  ability  to  repiesent  the  margin  of  tolerance  at 
the  closest  approach  between  machine  elements  which  is  useful  in  conjunction 
with  control  algorithms  for  actually  moving  the  machine  according  to  the 
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optimally  determined  trajectory. 

It  is  likely  that  the  ultimate  solution  to  computer  automation  and  control 
of  multidegree  of  freedom  structures  will  be  a  combination  of  the  four  ap¬ 
proaches.  However,  this  paper  will  pursue  development  of  the  transforma¬ 
tional  approach  in  order  to  define  its  potentials  and  produce  a  generally  useful 
theoretical  and  practical  tool  f^r  r  omputer  automation  in  this  class  of  prob¬ 
lems  i.e.  articulated  structures. 

CONFIGURATION  SPACE  AND  COLLISION  ZONES 

Before  describit^g  the  transformational  approach,  its  two  basic  opera¬ 
tional  problems,  are  stated.  -  -  -  -  -  -  -  - 

1.  Determination  of  collision  zones  (colliding  machine  configurations) 
in  configuration  space,  and 

2.  Definition  and  determination  of  optimal  collision  free  trajectories  in 
configuration  space. 

1 .  Configuration  Space 

A  "Machine"  can  be  defined  for  our  purposes  as  any  set  of  rigid  struc¬ 
tural  elements  whose  relative  orientations  one  to  another  and  to  a  frame  of 
reference  can  be  altered.  Except  for  pedagogical  purposes,  most  machines 
'  have  a  purpose  e.g.  a  remote  manipulator,  robot  etc.  At  some  level  a 
machine  can  be  dissembled  into  its  next  level  structural  elements.  The  level  we 
chose  is  that  in  which  the  elements  are  separately  identifiable  and  potentially 
capable  of  colliding  one  with  another  or  surrounding  objects.  The  separite 
elements  are  the  primitives  of  the  machine.  Figure  1  shows  a  schematic 
drawing  of  a  radiotherapy  machine  and  Figure  2  shows  its  reduction  to  its 
primitives . 


Figure  1.  A  Radiotherapy  Machine 
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Figure  2.  The  Radiotherapy  Machine  Reduced  to  its 

Primitive  Elements  for  Computer  Modeling 

In  addition  to  its  separability,  each  primitive  element  has  one  or  more 
degrees  of  freedom  for  its  movement.  In  general,  any  rigid  body  has  3 
translational  (x,  y,  z)  and  3  rotational  (pitch,  roll,  yaw)  degrees  of  freedom. 
Practically,  however,  most  such  elements  have  less  than  six  degrees  of  free¬ 
dom.  For  machine  control,  it  is  essential  that  the  translational  and  rota¬ 
tional  orientation  of  each  element  be  knowable,  e.g.  by  position  feedback 
potentiometers.  This  infornatlon  on  each  degree  of  freedom  of  each  ele¬ 
ment  may  be  absolute  (to  an  external  frame  of reference)or  relative  (e.g. 
to  its  connecting  neighbor).  Any  configuration  of  the  machine  is  then  com¬ 
pletely  speclfled  by  the  vector  of  values  of  each  degree  of  freedom.  The 
collection  of  degrees  of  freedom,  absolute  or  relative,  form  an  orthogonal 
basis  for  a  hyper  dimensional  space  (CONFIGURATION  SPACE*  in  which 
any  machine  configuration  is  uniquely  represented  by  a  vector  (point)  in  this 
space.  It  is  worth  emphasizing  that  this  point  in  configuration  space  may 
have  different  directional  dynamics  as  well  as  being  the  unique  representa¬ 
tion  of  the  machine  configureation.  Any  path  (trajectory)  traced  by  this  point 
in  configuration  space  defines  a  unique  sequence  of  machine  configurations. 

2.  Collision  Zones 


A.  Concept 

By  itself,  configuration  space  as  described  is  not  a  very  illuminating 
concept  although  for  example  it  can  quantify  the  similarity  or  proximity  of 
two  different  configurations  by  the  scalar  distance  between  the  correspond¬ 
ing  configuration  points.  The  essential  concept  for  machine  control  is  the 
presence  of  COLLISION  ZONES  within  Configuration  Space.  In  the  simplest 
case,  a  collision  zone  is  that  compact  set  of  points  in  configuration  space 
representing  all  the  values  of  the  degrees  of  freedom  of  two  machine  pri¬ 
mitives  which  place  them  in  collision  with  each  other.  TTtTie  two  elements 
have  5  degrees  oi  freedom  between  them,  and  if  the  two  can  collide,  the  col¬ 
lision  zone  will  be  essentially  five  dimensional.  Thus  a  second  feature  of 
configuration  space  is  that  there  will  be  at  most  as  many  collision  zones  as 
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there  are  pairs  of  collidable  machine  elements  although  two  or  more  zones  may 
intersect. 

As  an  illustration.  Figure  3  is  a  simple  machine  with  two  elements  each 
with  a  single  degree  of  freedom,  Although  it  does  not  seem  to  have  an  obvious 
purpose  this  will  be  discussed  later. 
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Configuration  space  for  this  machine  is  likewise  two  dimensional.  The 
machine's  configuration  is  defined  by  the  x  coordinate  of  the  center  of  one 
element  and  the  y  coordinate  of  the  center  of  the  other.  Thi^  (x,  y)  coordinate 
specifies  the  configuration  of  the  machine  and  is  a  point  in  a  configuration 
space  whose  orthogonal  basis  is  the  (x,  y)  degrees  of  freedom.  The  two 
elements  can  collide  for  certain  values  of  their  degrees  of  freedom  and  all  of 
these  values  are  represented  by  the  rectangular  collision  zone  in  configura¬ 
tion  space  as  in  Figure  4. 
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Figure  4.  Configuration  Space  with  Collision  Zone  for  a  Simple  Machine 
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This  Configuration  Space  wi^h  its  Collision  Zone  is  a  transformation  of 

the  machine.  The  3  points  in  configuration  space  uniquely  identify  3  different 
machine  configurations,  one  of  which  (6)  indicates  that  the  two  pieces  are  col¬ 
liding.  Although  it  would  seem  that  the  interior  of  a  collision  zone  is  unreach¬ 
able  and  thus  not  significant  because  it  would  involve  penetration  of  the  pieces, 
in  fact  there  is  a  utility  to  the  concept  of  interior  points  as  will  be  discussed 
later. 


Thus  a  dynamic  realworld  machine  can  be  transformed  into  a  static  re¬ 
presentation  in  which  all  of  the  conceivable  colliding  configurations  of  its 
parts  are  Immediately  obvious  by  the  collision  zone  (s).  This  simple  exam¬ 
ple  can  also  be  used  to  show  that  the  transformation  from  M  (machine)  space 
to  C  (configuration)  space  is  not  unique.  Figure  5  shows  two  apparently  dif¬ 
ferent  machines  which  have  an  identical  transformation. 


Figure  5.  Two  2  Degree -of-Freedom  Machines  with  an 
Identical  Transformation 

Thus  a  many-to-one  mapping  from  M  space  to  C  space  exists.  This 
poses  an  interesting  question.  If  different  machines  have  the  same  trans¬ 
form  to  C  space,  what  are  their  basic  simil  arities  in  M  space  other  than 
having  the  same  number  of  degrees  of  freedom?  A  possible  interpretation 
comes  from  study  of  the  purpose  of  machines  A  and  B  in  Figure  5.  If  the 
purpose  is  to  grind  the  two  blocks  by  keeping  them  in  contact  then  either 
mechanization  may  be  used.  In  fact,  machine  A  can  be  considered  as 
machine  B  with  the  frame  of  reference  in  B  taken  on  the  center  of  the  verti¬ 
cal  block.  From  that  reference  point,  it  appears  that  the  horizontal  block 
moves  around  it  as  in  machine  A.  Perhaps  other  machines  exist  with  the 
same  C  space  transformation.  Although  the  mapping  from  M  to  C  is  straight¬ 
forward,  if  tedious,  no  procedure  has  been  developed  for  performing  the  in¬ 
verse  C  to  M  transformation.  Because  the  two  machines  of  Figure  5  have 
the  same  C  space  transformation,  they  may  be  called  isoforms  of  each  other. 

Another  example  of  two  machines  with  the  same  transform  to  C  space 
will  be  given  later. 

B.  M  Space  to  C  Space  Transformation  -  Collision  Zones 

The  preceding  example  had  a  close  topographical  correspondence 
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between  C  space  and  M  space  and  between  machine  elements  and  collision 
zone.  In  fact  it  is  knownC  )  that  if  two  elements  are  convex  polyhedra  and 
move  only  in  translation  without  rotation,  then  their  collision  zone  will  be  a 
convex  polyhedron  as  well.  That  is.  in  general  two  3  dimensional  convex 
polyhedral  elements,  each  free  to  move  in  3  translational  degrees  of  freedom, 
generate  a  6  dimensional  convex  polyhedral  hull  in  C  space. 

However,  if  at  least  one  element  is  non  convex  and/or  at  least  one  ele¬ 
ment  has  at  least  one  rotational  degree  of  freedom  there  is  no  guarantee  that 
the  collision  zone  in  C  space  for  this  pair  is  convex  or  even  polyhedral  non 
convex.  The  utlility  of  convexity  and  polyhedrons  will  be  discussed  later. 


An  example  of  non  convex  non  polyhedral  collision  zone  transformed 
from  a  simple  machine  with  rotary  and  translational  movement  elements 
is  shown  in  Figure  6. 


Figure  6.  A  Simple  Rotary  and  Translational  Machine  Transforming 
to  a  Non-Convex  Non-Polyhedral  Collision  Zone 

As  a  further  example.  Figure  7  shows  a  planar  machine  with  two  trans¬ 
lating  and  one  rotating  element  with  a  total  of  thre*.  degrees -of-freedom  (x,  y,  d  ) 
This  machine  and  its  resulting  transform  can  be  considered  a  type  of  super¬ 
position  of  the  previous  two  simple  machines  of  Figures  3  and  6. 

These  three  degrees  of  freedom  form  the  basis  for  a  3  dimensional  C 
space.  There  are  three  collision  ^ones  which  intersect  because  of  the  loca¬ 
tion  of  the  machine  elements.  Figure  8  shows  this  union  of  the  3  separate 
zones. 
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Figure  7.  A  Simple  Three  Degree  of  Freedom  Machine 


Figure  8.  Configuration  Space  and  Composite  Collision  Zone 
for  the  Simple  Machine  in  Figure  7 

Even  though  only  one  "zone"  is  apparent  it  should  be  remembered  that 
a  zone  represents  machine  collision  configuration  for  a  pair  of  elements  and 
the  separate  collisions  by  pairs  can  still  be  identified  by  references  to  each 
zone.  In  general,  if  there  are  n  machine  elements  there  can  be  at  most 

collision  zones  all  or  some  of  which  may  intersect  to  form  one  or 
more  composite  zones.  Clearly,  even  if  each  individual  zone  is  a  convex 
polyhedron,  their  union  need  not  be. 


Because  each  blade  of  the  fan  element  can  be  Involved  in  a  collision  with 


a  slider  block,  there  are  multiple  fan  blade -block  zones.  A  second  feature 
of  C  space  that  may  seem  obvious  but  is  worth  mentioning  is  that  each  di¬ 
mension  of  the  space  can  be  scaled  to  plot  to  the  same  length  which  is  a  use¬ 
ful  concept  in  trajectory  related  Issues. 

C,  Determination  of  Collision  Zones 

There  are  3  approaches  to  obtaining  the  collision  zone  for  a  pair  of  col- 
lidable  elements.  These  are:  (1)  empirical,  (2)  Monte  Carlo,  (3)  correlation 
computations . 

1.  The  empirical  approach  would  utilize  the  machine  itself  or  a  faithful" 
model  of  it  which  can  be  (laboriously)  manipulated  so  as  to  map  out  the  zone 
for  an  element  pair.  Although  tedious,  this  may  be  the  only  tractable  way  to 
obtain  the  zone  for  complex  element  shapes.  This  technique  was  actually  used 
to  determine  the  3  dimensional  collision  zone  for  the  sourcehead-stretcherfoot 
element  pair  of  an  actual  machine  schematized  in  Figure  l  in  which  collisions 
between  these  two  elements  depend  on  the  arm  rotation  angle,  head  rotation 
angle  and  foot  rotation  angle.  The  zone  produced  is  "slightly"  concave  and 
not  polyhedral. 

2,  The  Monte  Carlo  approach  requires  a  faithful  computer  stored  geo¬ 
metric  model  of  the  machine's  primitive  elements.  Efisically,  a  random 
point  in  C  space  is  selected  and  model  given  the  corret ponding  orientation. 

The  collision  status  of  all  pairwise  elements  than  can  possible  collide  is 
then  checked.  Pairs  of  elements  that  can  not  collide  should  be  initially  elim¬ 
inated  to  save  time.  The  intersection  of  a  pair  of  elements  can  be  deter¬ 
mined  by  several  techniques  depending  upon  their  geometries  and  degrees  of 
freedom.  These  techniques  include*  analytic  geometry  and  projective  geo¬ 
metry. 

i) the  analytic  geometry  approach  utilizes  some  type  of  interpiece  dis¬ 
tance  calculation  and  is  best  suited  for  very  regular  convex  objects,  e.g.  two 
spheres,  or  a  sphere  and  cylinder  with  spherical  end  caps,  etc. 

ii)  in  the  projective  geometry  technique,  the  two  structures  in  question 
are  projected  onto  suitably  oriented  orthogonal  planes.  Convex  polyhedral 
structures  are  in  collision  if  and  only  if  their  convex  projections  overlap  on 
two  orthogonal  projections.  In  the  case  of  a  sphere,  overlap  in  all  3  ortho¬ 
gonal  projections  is  necessary  and  sufficient.  In  one  sense,  the  projective 
method  is  fundamental  for  determining  intersection  of  any  two  elements  re¬ 
gardless  of  their  geometries.  The  difficulty  of  coarse  is  in  finding  a  suit¬ 
able  set  of  orthogonal  planes  for  checking  overlapping  projections.  The  pro¬ 
jection  technique  mimics  the  "moving  eye"  method  of  checking  for  collisions. 

If  a  "hit"  is  signaled  for  collision  between  two  elements,  the  configuration 
point  is  stored  for  that  pair  (collision  zone).  Optimized  search  techniques 
(e.g.  Fibonacci,  golden  mean,  or  others)  may  be  used  to  search  for  the  bound¬ 
ary  of  the  zone  along  a  dimension  in  C  space.  Obviously  the  Monte  Carlo 
approach  needs  considerable  sophistication  in  application.  However,  colli¬ 
sion  zones  need  only  be  computed  once  for  any  machine  and  this  can  be  done 
off-line.  Considering  the  time  required  to  design  and  construct  any  machine^ 
the  time  to  transform  it  to  C  space  would  seem  a  reasonable  investment  if  it 
leads  to  improved  automation  control  and/or  design. 


In  either  the  analytic  or  projective  geometry  technique,  the  utility  of 
convex  polyhedral  or  regular  conic  solids  for  machine  elements  is  obvious. 
As  the  machine  elements  acquire  sculpting  such  as  compound  and  developed 
surfaces,  any  mathematical  methods  for  accurately  determining  collision 
zones  become  increasingly  difficult.  Attempting  to  model  an  actual  machine 
by  regular  primitives  such  as  is  done  in  CAD/CAM  applications  is  an  obvious 
approach.  The  application  of  CAD/CAM  in  design  may  in  fact  be  an  essential 
step  in  the  M  to  C  transformation.  Hidden  line  algorithms  may  be  related  to 
the  transformation  problem. 


below. 


Computation  of  collision  zones  by  a  correlation  technique  is  outlined 


omoutatlon  of  the  Collision  Zone  by  Correlation  Type  Methods 


i.  Some  specific  examples. 

The  determination  of  the  collision  zone  requires  a  mathematical  descrip 
tion  of  each  component  and  its  movement,  and  the  determination  of  when  differ 
ent  components  intersect.  As  a  simple  example  consider  the  machine  of 
Figured.  Defining  ^ 

p(X/fc>JH  j 

(  I  .  ^  h 


5  ^  O  ,  o’*'?'’-*' 


the  two  squares  are  then  respectively 


p VO  pcy/0  , 

The  degree  to  which  they  intersect,  as  a  function  of  and  y^,  is  given  by  cor 
relation  type  expression  ,n 

r 


2  TV/, )  = ,  ,  ^  O -  X ,  y )  ^ 


which  reduces  to 


Noting  that 


'/C  -/  > 


I  ) 

--  J  p((>!-^^/0<JKj  p',Ly-y^)/,Uy 

^  ofhryJiSC 


which  is  in  turn  2q(x^/Z),  we  can  write 


(Ly/P)- 


a  rectangular  pyramid  whose  base  is  the  collision  zone  of  Figure  4  and  whose 
maximum  height,  at  =  o,  y^  =  0,  is  equal  to  4.  0.  The  height  of  e(x^.  is 

a  measure  of  intersection  (collision  severity)  between  the  two  components  of 
the  machine. 


A  similar  approach  could  be  used  in  computing  the  collision  zone  for  the 
machine  in  Figure  6.  The  propeller  is  conveniently  described  in  polar  coor¬ 
dinates  and  the  resulting  mix  of  polar  and  rectangular  coordinates  leads  to 
significantly  greater  mathematical  difficulties. 

These  two  examples  represent  machines  where  degrees  of  freedom  are 
independent.  Thus,  _the  location  in.M  space  of  any  component  is  a  function  of 
only  one  degree  of  freedom.  By  contrast,  for  a  multiple  joint  arm  individual 
movable  joints  are  linked  together  and  more  complicated  expressions  result. 

ii.  More  generalized  considerations 


In  the  previous  examples  of  the  sliding  squares  the  collision  zone  was 
calculated  using  a  spatial  correlation  type  equation.  Equation  (1)  can  be 
generalized  as 

j  ]  £  (2 

yy 

with  f  and  f  the  corresponding  shapes  (i.e.,  squares  in  the  example  shown). 
X  y 

A  change  in  coordinates. 


U  =  X  -  X 


leads  to 


this  expression  is  similar  to  ^ 
of  f  and  f  .  Specifically 

X  y 


e  two  dimensional  cross  correlation,  , 


where  the 


results 


8  from  the.  u  +  x  rather 


than  u  -  X  term, 
o 


Thus 


z(x^,  y^)  is  the  cross  correlation  reversed  in  the  x{or  u)  direction. 

The  outline  of  z(x^,  y^)  can  thus  be  determined  by  holding  f^  stationary,  mov¬ 
ing  fy  around  it  such  that  the  two  remain  tangent,  recording  the  shape  outlined 
by  the  coordinate  center  of  f^,  and  then  reversing  the  resultant  figure  in  the  x 

direction.  (This  recalls  the  empirical  method  for  collision  zone  determina¬ 
tion.  )  The  previous  example,  where  f  and  f  were  squares,  obscures  this 

X  y 

reversal  due  to  symmetry,  but  a  later  example  will  illustrate  this  point. 
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iii  Orthogonalizing  a  Machine 

The  question  arises  as  to  how  general  the  correlation  approach  is  for 
planar  figures.  Consider  the  machine  shown  in  Figure  9a.  The  two  squares 
no  longer  move  in  orthogonal  directions:  in  particular,  the  expression  for  the 
block  located  by  y^  must  change  since  its  value  as  a  function  of  x  is  now  de¬ 
pendent  on  y^.  As  a  result  the  simple  correlation  relationship  of  equation(2) 
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no  longer  holds. 


Figure  9.  A  Non -Orthogonal  Machine.  Its  Collision  Zone  and 
Orthogonal  Isoform 

One  approach  is  to  seek  an  equivalent  orthogonal  machine  where  by  equi¬ 
valence  we  mean  generating  the  same  collision  zone  (an  isoform).  This  col¬ 
lision  zone,  determined  by  trial  and  error,  is  shown  in  Figure  9b.  Figure  9c 
indicates  an  equivalent  orthogonal  machine,  again  determined  from  Figure  9b, 
by  trial  and  error.  Note  that  given  the  orthogonal  machine  the  collision  zone 
could  then  be  determined  using  the  correlation  approach,  that  is,  by  holding  the 
horizontally  sliding  component  and  moving  the  vertically*  sliding  component  tan¬ 
gentially  around  it.  The  necessary  reversal  of  this  resulting  shape  becomes 
evident  in  this  case. 

Of  course  the  appiroach  taken  here  does  not  follow  the  desired  order. 

What  we  wish  to  do  is  to  determine  the  equivalent  orthogonal  machine  direct¬ 
ly  and  then  utilize  the  correlation  approach  to  determine  the  collision  zone. 
Inspection  of  Figures  9a  and  9c  indicate  that  a  simple  transformation  suffices. 
Note  that  the  horizontal  distance  ab  is  conserved  where  b  is  on  the  track  of 
the  'Vertically”  moving  object.  The  same  holds  for  all  other  horizontal  dis¬ 
tances.  Thus  the  simple  coordinate  transformation 

('X,y)-^CX4-y4nn©,  y) 

allows  determination  of  tne  orthogonal  machine.  A  comparison  of  the  colli¬ 
sion  zone  in  Figure  9b  to  that  in  Figure  4  indicates  the  possibilities  for  direct¬ 
ly  transforming  the  collision  zone  itself. 

This  orthogonalizing  technique  has  potential  application  to  the  computa¬ 
tion  of  collisioii  zones  when  components  move  along  curved  trajectories. 

Figure  10  indicates  such  an  example.  An  incremental  region  is  indicated  for 


Figure  10  Differential  Elements  in  Collision  Along  Curved  Paths 

each  component.  The  trajectories  of  these  incremental  regions  intersect  and 
contribute  to  the  overall  collision  zone.  These  latter  trajectories  can  be  ap¬ 
proximated  near  their  intersection  by  two  straight  lines  and  the  orthogonaliza- 
tion  approach  can  be  used. 

The  examples  chosen  for  illustration  resulted  in  no  more  than  a  3  di¬ 
mensional  C  space.  Obviously  a  machine  such  as  in  Figure  1  has  a  nonvis- 
ualizable  C  space.  However,  the  hyperdimensional  C  space  and  collision 
zones  do  not  differ  in  prinlciple  from  those  for  a  3-D  C  space. 

The  problem  of  inverse  transformation  from  C  space  to  a  generating 
machine  of  elements  and  degrees  of  freedom  has  not  been  approached  in  any 
detail  yet.  The  apparent  many-to-one  M-to-C  space  transform  of  Figure  5 
would  suggest  that  the  inverse  transform  will  have  to  be  carefully  consider¬ 
ed.  A  basic  question  is  whether  the  two  machines  of  Figure  5  are  in  fact 
"different'*  because  of  their  movement  structure  or  Identical  in  that  their  pur¬ 
pose  is  to  grind  one  block  against  another.  If  a  third  machine  with  the  same 
transform  could  be  found  whose  structure  and  purpose  are  both  essentially 
different  from  the  two  machines,  it  would  suggest  a  fundamental  problem  in 
inverse  transformation  (but  not  in  the  utility  of  the  M  to  C  transformation). 
Inverse  transformation  is  useful  for  design  purposes.  The  forward  trans¬ 
formation  is  useful  for  control  purposes. 

Because  a  collision  zone  represents  restricted  machine  configurations, 
the  notion  may  be  extended  to  limitations  on  the  range  of  movement  of  a  de¬ 
gree  of  freedom  regardless  of  collision  concerns.  Such  a  zone  may  occur 
as  a  "wall"  in  C  space  to  define  the  extent  of  an  axis.  An  unrestricted  rota¬ 
tional  degree  of  freedom  will  generate  a  periodic  structures  (as  in  Figure 
8). 

C.  OPTIMAL  TRAJECTORIES  IN  C  SPACE  -  MACHINE  CONTROL 
I.  INTRODUCTION 

As  mentioned  previously,  the  M  to  C  operation  transforms  a  dynamic, 


geometric  machine  with  many  moving  parts  to  a  static  representation  in 
which  the  instantaneous  machine  configuration  is  a  point  in  C  space.  The 
control  problem  is  to  change  the  machine  from  configuration  A  to  B  without 
producing  any  undesired  collisions  and  usually  in  some  "optimal"  fashion. 
This  correspondr  to  finding  a  C  space  trajectory  connecting  A  and  B,  that 
does  not  pass  through  any  collision  zone  and  that  has  the  optimal  properties. 
There  can  be  several  optimal  criteria  which  include 

.  time  optimal  -  e.g.  minimum  time  from  A  to  B 
.  tolerance  optimal  -  no  closer  than  E  to  any  collision  zone 
.  minimum  reversals  of  motions 
.  minimum  information  storage. 


Before  discussing  such  trajectories  several  basic  properties  of  a  tra¬ 
jectory  in  C  space  are  given. 

Figure  11  presents  the  machine  of  Figure  3  with  its  C  space  transform 
and  several  trajectories  between  A  and  B. 


Figure  11.  Trajectories  in  C  Space 

An  essential  property  of  a  trajectory  is  that  any  point  on  it  represents 
not  only  a  unique  ma':hine  configuration  but  also  the  instantaneous  relative 
velocities  of  the  degrees  of  freedom.  Time  is  not  implicity  nor  explicitly 
evident  on  a  trajectory.  Thus  a  straight  segment  of  a  trajectory  simply 
means  that  at  any  point  on  the  line  the  two  blocks  maintain  the  same  instan¬ 
taneous  _rel^ti^  velocities  that  is: 

m  =  ^  Vis_ 

AYo  AT  AYo  Vy 

Vx  =  nnVy 

Thus  the  blocks  may  accelerate,  decelerate,  atop,  move  at  constant  velocity 
and  as  long  as  the  instantaneous  velocities  retain  the  same  ratio,  the  trajec¬ 
tory  will  describe  a  straight  line  in  C  space.  Or  inversely,  the  local  slope 
in  the  trajectory  is  determined  by  the  instantaneous  ratio  of  velocities  of  the 
degrees  of  freedom.  A  straight  line  trajectory  can  be  a  minimal  time  tra¬ 
jectory  but  need  not  be  the  only  one.  The  shortest  distance  in  C  space  is  not 
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necessarily  the  only  time  optimal  policy.  The  meaning  of  the  path  slope  and 
time  is  complicated  by  the  dynamics  of  the  machine  elements. 

A  simple  example  of  the  above  statments  is  shown  in  Figure  12  which 
shows  two  dimensional  C  space  reticulated  into  a  grid  in  which  movement  can 
only  be  from  point  to  point  as  shown  with  the  objective  of  reaching  point  O  in 
the  shortest  time  from  any  other  point  shown. 


Figure  12.  Minimum  Time  Trajectories  in  a  Reticulated 
2  Dimensional  C  Space 

This  figure  assumes  that  each  degree  of  freedom  can  move  at  the  same  maxi¬ 
mum  velocity  in  C  space  (by  suitable  scaling).  The  points  labeled  with  the 
same  numbers  then  indicate  that  they  are  the  same  time  distance  away  from 
O.  The  figure  shows  that  a  45°  line  connecting  two  points  is  the  "fastest" 
trajectory.  For  example,  once  ona  45°  line  to  point  O,  no  movement  off 
it  is  allowable  while  retaining  minimal  time.  However,  at  any  point  off  the 
diagonal  to  point  O,  there  can  be  a  number  of  time  optimal  trajectories. 

This  reticulated  example  may  be  considered  to  exist  on  as  sr.iall  a  scale  in 
C  space  as  desired. 

A  more  rigorous  analysis  of  trajectories  and  obstacles  is  given  below. 

n.  AN  EXAMPLE  IN  SOME  DETAIL;  TRANSLATIONAL  MOTION  ONLY 

The  configuration  space,  with  collision  zone,  of  the  machine  in  Figure  3 
la  a^in  repeated  in  Figure  13.  Three  possible  trajectories  from  an  initial 
configuration,  =  -p,  y^  =  'p,  to  a  final  configuration,  x^  =  P  #  yQ=P  ,  are 

shown. 
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Fijure  13  .  Trajectories  In  a  Two-Dimensional  Configuration  Space 

The  slope,  m,  of  a  trajectory  indicates  the  relative  velocity  of  the  two 
squares.  Thus  if  m  >  1  the  "y-  square'*  is  moving  more  rapidly,  if  m  <  1  the 
reverse  is  true.  In  all  three  slopes  shown  the  y-  square  first  moves  more 
rapidly,  then  the  x-square  does. 

In  considering  these  trajectories  the  following  two  simplifying  assump¬ 
tions  will  be  made. 

1.  One  or  the  other  of  the  two  squares  is  always  moving  at  the  highest 
allowable  speed, 

2.  Instant  acceleration  is  allowed  (thus  thecorners  in  the  trajectories). 
Given  assumption  1  it  follows  that  for 


m>i  j  Vy  ^  ^  V,  =•  5^,,  /Vn 

5  =  ■/,  “ 

Finally,  note  that  trajectories  2  and  3  are  "just  miss"  trajectories  while 
trajectory  1  included  a  larger  safety  factor. 

A.  Minimum  Time  Trajectories 

Since  one  or  both  of  the  squares  are  always  i.  ■'g  at  top  speed,  and  the 
value  of  m  determines  which  one, the  for  jwing  rules  a  used  to  compute  the 
time  required  for  a  trajectory: 

1.  determine  those  sections  cf  the  trajectory  for  which  m  >  1,  m  =  1 
and  m  r*!. 

2.  Determine  the  total  length  of  the  trajectory's  projection  on  the  y^ 
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axis  where  m  >  1,  on  the  axis  where  m<l  and  on  one  or  the  other  where 
m  =  1. 

3.  Divide  this  total  projection  length  by  8,^^^  obtain  the  trajectory  time. 

Consider  the  trajectories  of  Figure  13  using  the  rules  just  listed  ,  the 
following  times  can  be  computed, 

a.  Trajectory  1.  = 'C  C  . 

b.  Trajectory  2.  ■  Cf  -  (  U  ^  L  Zip*  p]/ 

_ . 

We  note  that  the  two  ’’just  miss'*  trajectories  take  equal  time,  though  in  con¬ 
figuration  space  they  are  not  the  same  length.  We  now  state  a  general  criterion 
for  the  shortest  time  trajectory  between  two  points  in  configuration  space  that 
can  be  connected  by  a  straight  line  not  intersecting  a  collision  tone  (i.e.  a  pair 
of  "unobstructed"  points). 


Criterion  - 


Given  two  "unobstructed"  points,  Uj  =  (xj,  y^)  and  u^  =  (x^,  y2^r 


assuming  that 


1  \  1 

then  any  trajectory  from  Uj  to  U2  such  that  Iml^J.  |  over  the  cornplete 
trajectory  is  a  minimum  time  trajectory  between  u^  and  U2*For  |  ,  <1 


the  condition  is  |ml  i  I  •  If  this  criterion  is  not  met  the  trajectory  is 
not  minimum  time.  (In  physical  terms  this  means  that  one  specific 
component  goes  at  top  speed  the  entire  trajectory, ) 


We  now  introduce  an  optimality  principle  -  a  minimum  time  trajectory 
consists  entirely  of  minimum  time  subtrajectories  between  unobstructed  points. 
This  is  a  necessary  but  not  sufficient  condition  as  we  shall  see. 


Next,  we  investigate  the  trajectories  of  Figure  13.  Trajectories  2  and 
3  meet  the  criterion  over  their  complete  lengths,  and  are  in  fact  minimum  time 
trajectories.  Thus  minimum  time  trajectories  are  not  unique;  an  infinite  num¬ 
ber  may  exist.  The  underlined  word  any  in  the  criterion  ensures  this. 
Trajectory  1,  as  determined,  takes  longer.  Note  points  Wj  and  w^.  The  tra¬ 
jectory  between  these  points  falls  the  criterion  and  ensures  that  trajectory  1  is 
not  minimal  time. 


Before  preceding  we  should  note  that  if  the  maximum  speed  of  the  two 
squares  differed,  either  the  criterion  would  have  to  be  adjusted  or  the  figure 
scaled  appropriately.  Scaling  according  to  maximum  speeds  seems  to  offer 
the  better  remedy  in  terms  of  ease  of  interpretation.  Moreover,  considering 
Figure  6  where  one  movement  is  rotational,  the  relative  scaling  is  arbitrary 
to  begin  with.  Appropriate  scaling  means  that  an  equal  distance  on  the  figure, 
either  vertically  or  horizontally,  should  require  an  equal  time  at  the  maxi-^ 
mum  speeds.  The  assumption  of  Figure  6  is  that  the  propeller  can  turn  90 
in  the  same  time  the  square  moves  five  units,  both  going  at  top  speed. 


ft,  vrJ) 
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B.  Minimum  Information  Storage  Trajectories 


We  now  consider  the  amount  of  information  it  takes  to  specify  a  trajec¬ 
tory.  If  the  machine  control  is  to  be  computer  driven  then  this  determines 
the  number  of  instructions  required.  If  information  storage  or  the  time  re¬ 
quired  to  input  this  storage  are  important  constraints  on  operation  it  may  be¬ 
come  desirable  to  minimize  (to  some  degree)  the  required  instructions. 

If  a  trajectory  consists  of  straight  line  segments  then  the  breakpoints 
must  be  given  and  the  required  slopes  can  then  be  determined.  The  initial  and 
final  configuration  points  are  required,  but  are  common  to  all  trajectories. 
Comparing  the  trajectories  of  Figure  12  we  see  that  trajectories  1  and  2  require 
- -less -information  than  trajectory- 3,  two  line  segments-to -the  latter's  four. 

Could  we  do  better  perhaps  witVx  a  smooth  curve  from  the  initial  configuration 
point  to  the  final  configuration  point.  The  minimum  we  we  would  require  to 
avoid  the  collision  zone  is  a  quadratic  curve,  specified  by  three  points,  the 
initial  and  final  points  being  two.  This  is  equivalent,  in  information,  to  the 
two  line  segment  trajectory  and  is  therefore  also  a  minimum  information  tra¬ 
jectory.  We  might  note  that  the  quadratic  passing  through  the  corner  point, 

=  -q,  =  q,  is  also  a  minimum  time  trajectory  as  well. 

m.  An  Example  with  Rotational  and  Translational  Motion 


Figure  14  indicates  an  initial  and  final  configuration  for  the  machine  of 
Figure  6,  and  indicates  three  different  trajectories.  The  scales  are  measured 
in  units  of  d,  according  to  the  scaling  concept  previously  defined.  Assuming 
again  some  scaled  maximum  speed,  that  for 


Trajectory  I 


Trajectory  2 


T^-  (fin 3/ i f  ,  =  'i.'xi/t,,. 


Tr.j.ctor  r,  A' a.V ('"‘r- i.;)  i 


Figure  14.  Trajectories  in  a  Two  Dimensional  Configuration  Space; 
Machine  with  Rotational  Motion 
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Trajectory  Z  is  the  shortest,  in  spite  of  the  fact  that  trajectory  1  re> 
quires  less  overall  movement  of  the  propeller.  The  long  segment  of  trajec¬ 
tories  2  and  3  at  a  -45°  angle  correspond  to  both  moving  parts  moving  at  near 
top  speed  simultaneously,  and  make  these  faster  than  trajectory  1. 

All  three  trajectories  meet  the  optimality  condition  noted  earlier.  Tra¬ 
jectories  1  and  Z  correspond,  evidently,  to  local  minimums,  whereas  trajectory 
2  is  a  global  minimum,  though  again,  not  unique. 

Figure  15  illustrates  another  point.  The  trajectory  shown  requires  the 
elapsed  time  of 

-  -  -  T-  *-  w.y  )/s^, 

and  is  a  global  minimum,  u^  and  u^  are  not  an  unobstructed  pair  of  points, 

yet  the  trajectory  touches  no  point  or  edge  of  the  collision  zone.  While  some 
of  the  globally  optimal  trajectories  do  have  such  "touch"  points  clearly  such  a 
safety  margin  is  desirable  when  it  can  be  achieved. 

Qc 


O  Id  2d  Jd  id 

Figure  15.  Aji  Optimal  Time  Trajectory  Not  Exhibiting 
'O'ust  Miss"  Characteristics 

IV.  Trajectories  in  More  Than  Two  Dimensions 

If  we  consider  minimum  time  trajectories  in  more  than  two  dimensions 
we  once  again  can  assume  that  at  all  times  at  least  one  component  is  moving  at 
maxinnum  speed.  An  optimality  principle  similar  to  the  two  dimensional  case 
would  seem  to  exist.  Once  again,  the  trajectory  between  two  unobstructed 
points  should  include  one  component  going  at  top  speed  the  entire  way,  with  the 
other  components  traveling  at  appropriately  reduced  velocities.  Multiple  di¬ 
mension  problems  are  not  direct  extensions  of  the  two  dimensional  case,  how¬ 
ever,  due  to  the  pairwise  nature  of  collisions.  Thus  while  two  squares  on  or¬ 
thogonal  tracks  generate,  as  shown,  a  square  collision  zone,  three  cubes  on 
orthogonal  tracks  do  not  generate  a  cubic  collision  zone,  but  rather  a  more 
complicated  figure. 
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Each  machine  degree  of  freedom,  as  read  from  a  position  feedback  po¬ 
tentiometer  for  instance,  can  form  an  orthogonal  basis  for  C  space.  In  the 
event  that  one  degree  of  freedom  is  not  independent  of  another  over  part  of 
their  ranges  (as,  for  example,  if  the  two  slider  blocks  in  Figure  3  were  con¬ 
nected  by  a  two  bar  linkage)  then  the  restriction  is  not  on  the  C  space  itself 
but  on  the  allowable  trajectories  in  C  space.  Again  such  restrictions  may 
be  viewed  as  "collision"  zones  in  which  trajectories  lying  on  (not  in)  the  sur¬ 
face  of  the  zone  are  acceptable. 

TOLER ANCING  AND  Ad  Hoc  TRAJECTORY  CHECKING 

-  -  Although  C-space  with  its  collision  zones-provides  the  conceptual  frame-  - 

work  for  planning  optimized  collision  free  trajectories  for  the  transformed 
machine,  actual  determination  of  such  a  path  in  hyperdimensional  space  is  not 
always  evident.  The  methods  described  by  Perez'®^  of  slicing  a  three  di¬ 
mensional  polyhedral  zone  into  a  series  of  parallel  2  dimensional  polyhedral 
zones -and  then  proceeding  from  vertex-to-vertex  through  the  stack  is  a  use¬ 
ful  approximation  method  of  procedure. 

Another  approach  that  has  been  tried^*‘*^  is  to  plan  a  type  of  "straight- 
line"  trajectory  from  known  initial  to  final  configuration  and  then  with  com¬ 
puter  model  mimic  technique  to  move  the  model  into  successive  positions 
along  the  trajectory,  checking  for  model  collision  at  each  point.  Should  no 
impending  collisions  be  signaled,  the  trajectory  is  declared  "safe"  and  move¬ 
ment  may  be  implemented.  The  3  basic  questions  with  this  method  are: 

1.  Are  configurations  not  checked  also  safe? 

2.  How  close  is  this  trajectory  to  a  collision  zone? 

3.  If  the  checked  trajectory  is  signaled  as  unsafe,  how  is 
another  trajectory  chosen  for  checking? 

The  first  two  questions  will  be  elucidated  by  examples  from  actual  ex¬ 
perience  with  computer  control  of  a  radiotheratron  machine. 

The  third  question  will  not  be  treated  here  since  it  is  a  fundamental  pro¬ 
blem  with  this  approach  and  usually  employs  machine  specific  ad  hoc  strategies 

Basically,  prechecking  every  point  (machine  configuration)  on  a  selected 
trajectory  is  obviously  impossible.  However,  even  checking  a  finite  but  large 
number  of  configurations  may  be  practically  impossible  if  time  is  critical. 

For  any  trajectory  checked  at  a  finite  number  of  points  and  signaled  "t.'>fe" 

(l.e.  none  of  the  checked  configurations  are  colliding  ones),  there  is  a  definite 
probability  that  a  segment  of  the  trajectory  passes  through  or  touches  a  colli¬ 
sion  zone.  Furthermore  this  probability  Increases  as  the  number  of  checked 
points  decreases,  for  example,  in  an  effort  to  save  computer  time.  An  ex¬ 
ample  of  this  relationship  is  shown  in  Figure  1ft  which  plots  the  number  of  pre- 
checked  points  against  the  probability  of  a  trajectory  signaled  "safe"  actually 
being  totally  outside  of  a  collision  zone.  The  collision  possibility  being  check¬ 
ed  is  that  between  the  large  sourcehead  of  the  machine  and  a  half  cylinder  re¬ 
presenting  a  patient  on  the  treatment  stretcher.  In  addition  to  the  detection 
probability,  a  "severity"  of  penetration  of  the  sourcehead  inside  the  cylinder 
(patient)  is  also  plotted. 
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Figure  16.  Predetection  Probability  of  a  Collision  and  the 
Collision  Severity  as  Depending  on  the  Number 
of  Points  Checked 

As  intuitively  obvious,  as  the  number  of  equally  spaced  points  checked 
on  a  trajectory  increase,  the  chance  of  falsely  signaling  it  as  safe  and  the 
severity  of  the  undetected  collision  decrease.  The  main  point,  however,  is 
that  for  any  finite  number  of  points  prechecked,  there  is  always  a  probability 
of  an  undetected  collision  and  the  most  that  can  be  hoped  is  that  the  undetect¬ 
ed  collision  is  a  "grazing"  one  in  which  the  trajectory  touches  but  does  not 
penetrate  a  collision  zone.  The  significance  of  a  grazing  collision  depends 
of  course  on  the  application. 

The  second  problem  of  "how  safe  is  safe"  refers  to  the  distance  between 
a  trajectory  and  the  nearest  collision  zone.  During  movement  control,  the 
machine  may  stray  from  the  trajectory  for  many  reasons.  If  the  trajectory 
is  not  sufficiently  far  from  a  zone,  the  new  trajectory  may  enter  it. 

A  commonly  suggested  attempt  to  solve  both  problems  Involves  putting 
a  tolerance  around  each  collision  zone  in  C  space  or,  equivalently,  artificial¬ 
ly  enlarging  one  or  both  machine  elements  in  a  collision  pair.  This  solution 
has  two  drawbacks.  The  first  is  that  while  increasing  the  probability  of 
signaling  a  true  colliding  trajectory  such  enlargement  results  in  the  probability 
of  false  alarms  in  which  a  safe  trajectory  is  rejected.  The  second  drawback 
is  that  zone  enlargement  reduces  the  free  space  in  which  trajectories  must  lie 
Increasing  the  difficulty  of  their  selection. 

The  relationship  between  original  and  Inflated  zones  and-  the  probability 
of  missing  a  true  collision  or  falsely  signaling  a  safe  trajectory  as  unsafe  is 
shown  in  Figure  17. 
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Figure  17.  Zone  Tolerancing  and  False  Alarm  Introductions 

Figure  18  presents  the  Hit  and  False  Alarm  detection  curves  for  colli 
sions  between  the  rad'otheratron  sourcehead  and  half  cylinder  (patient)  for 
various  percentages  of  sourcehead  enlargements.  The  number  of  points 
prechecked  on  the  straight  line  trajectory  are  plotted  parametrically. 
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Figure  18.  Hit  and  False  Alarm  Detections  of  Unsafe  Trajectories 
for  Various  Amounts  of  Machine  Part  Enlargement 

Again,  the  particulars  in  this  figure  may  be  expected  to  vary  depending 
upon  the  machine  specifics.  However,  the  general  nature  will  remain. 


The  significance  of  false  alarms  is  that  an  otherwise  safe  trajectory  will  be 
rejected  and  a  new  one  must  be  postulated  and  checked  which  unnecessarily 
adds  to  the  time  involved. 

Thus  although  tolerancing  is  a  reasonable  suggestion,  the  penalties 
attached  can  be  significant. 

DISCUSSION  AND  CONCLUSIONS 


A  general  transform  approach  to  collision  free  computer  control  of  a 
muitidegree  of  freedom  machine  has  been  briefly  presented  together  with 
several  of-its  implications  and-problems.  Our  experience  with  this  approach 
has  resulted  in  progressive  understanding  of  the  problem  as  well  as  uncovery 
of  related  issues.  This  approach  appears  to  lead  to  continual  insights  and 
connections  with  other  seemingly  unrelated  areas.  At  present  we  are  inves* 
tigating  dynlmical  aspects  of  machine  movement  and  their  trajectory  implica¬ 
tions. 


The  major  drawbacks  with  the  transform  approach  are  the  difficulty  of 
visualization  on  which  much  insight  depends  and  certain  computational  and 
storage  problems  related  to  collision  zone  determination  and  storage  and  non* 
convex  and/or  non- polyhedral  zones. 

Future  work  is  directed  to  rapid  visual  display  of  zones,  trajectories, 
machines,  etc.  on  a  CAD/CAM  system,  polyhedral  approximations  to  ma¬ 
chine  elements  and/or  collision  zones  and  optimal  trajectory  synthesis  and 
study  of  the  reverse  transformation  problem  as  a  possible  aid  to  rational 
design  of  machines  with  reduced  collision  proneness. 

The  utility  of  CAD/CAM  design  of  machines  may  also  lie  in  the  fact 
that  such  computer  aided  design  also  implies  that  all  relevant  machine  geo¬ 
metry  thereby  exists  in  computer  storage.  Thus  computation  of  collision 
zones  directly  from  this  information  would  seem  highly  feasible. 

This  paper  attempted  to  present  some  of  the  basic  concepts  and  consid¬ 
erations  of  configuration  space,  collision  zones  and  trajectories  for  machine 
control  -  primarily  as  they  were  developed  for  computer  control  of  a  radio- 
theratron  machine.  Further  discussion  of  this  approach  can  be  found  in 
the  references. 
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Previous  ^esearoh  has  shown  that  we  use  perceptual  Inputs  froa  sensations 

of  both  nasa  and  saas  Bonent  of  inertia  in  handling  and  annually  oontrolllng 

0-^ 

objects  in  our  envlronaent^Ml^  Mass,  the  resistance  to  linear  aooeleration, 
and  aass  aoaent  of  inertia,  the  resistance  to  angular  aooeleration,  are 
fundaaental  properties  of  objects  in  both  a  physical  and  peroeptual  sense.  The 
relative  laportanoe  of  oass  aoaent  of  Inertia  as  a  peroeptual  input  has  been 
largely  overlooked.  Bxperlaents  are  being  oonduoted  "In-thres'stage^to  study 
the  peroeptual  equation  of  these  two  properties* 

The  first  stage  Involves  the  peroeptual  scaling  of  aass  aoaent  of  inertia, 
oovering  the  range  typloal  of  slaple  aanlpulatlve  tasks  (0.15  to  1.15  Inch 
poqnda  seo^-lv  Prellalnary  experlaents  have  been  coapleted  and  are  discussed* 
belowV  The  second  stage  will  involve  peroeptual  scaling  of  aass  or  weight, 
oovering  the  range  most  often  found  in  tools  used  for  slaple  annual  tasks  (4 
oz.  to  10  lbs.}.  The  third  stage  will  involve  asking  subjects  to  equate  the 
perceived  mass  acaent  of  inertia  of  one  set  of  stlaull  with  the  perceived  mass 
(weight)  of  a  second  set. 


*0ak  Ridge  Associated  Universities  perfonu  coaplaaentary  work  for  the 
O.S.  Departaent  of  Energy  under  contract  No.  DB-AC05-960R00033. 
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PBRCBPTDAL  SCALINQ  OP  MOMENT  OF  INERTIA 


APPARATUS 

Plgura  1  llluatratM  the  apparatua  uaed.  AS”  plexiglaaa  T  handle  was 
fixed  to  a  plexiglaaa  shaft  13*  loog  and  1*  in  diameter.  The  shaft  rested  on 
two  ball  bearings  mounted  6”  apart.  A  2 A"  length  of  plexiglass  was  glued  at 
the  end  or  the  shaft,  with  12  holes  drilled  aynmetrioally  at  different 


Figure  1.  Naas  Moment  of  Inertia  Apparatus 


positions  along  its  length.  The  hole  positions  were  seleoted  so  that  the  mass 
moment  of  inertia  inoreased  by  equal  ratios  when  a  pair  of  2  lb.  weights  were 
moved  from  2  holes  equidistant  from  the  center  point  of  the  24”  length  to  the 
adjaoent  boles.  The  mass  moment  of  inertias  were  thus  linearly  spaced  on  a 
logrlthmic  soala.  Six  different  mass  moments  of  inertia,  one  for  each 
ayMetrioal  pair  of  holes,  could  be  generated. 


SUBJECTS 

Subjects  were  17  volunteers,  employees  or  fSally  members  of  employees,  of 
Oak  Ridge  Associated  Universities. 


EXPERIMENTAL  DESIGN 


Each  of  the  6  mass  moments  of  inertia  was  presented  to  the  subjects  once 
In  each  of  3  trials,  varying  the  order  of  presentation  from  1  to  6  randomly 
within  eaoh  trial.  Subjects  were  divided  Into  3  groups,  each  group  being  given 
different  Instructions. 

OlIfiUA  1  H  Subleotal 

The  weights  were  positioned  at  the  third  hole  from  the  center.  Subjects 
were  instructed  to  "move  the  T  bar  with  your  preferred  hand  frcm  side  to  side 
and  concentrate  on  the  feeling  of  'top  heaviness'  or  'wanting  to  keep  on  going' 
when  you  reverse  direction.  Concentrate  on  this  feeling  and  give  It  a  number, 
any  number  you  wish."  When  the  subject  bad  assigned  a  number.  Instructions 
continued:  "Now,  I'm  going  to  change  that  feeling  of  top  heaviness  and  I  want 
you  to  concentrate  on  the  new  feeling  and  give  It  a  number.  If  the  feeling  is 
twice  as  large  double  the  number",  etc. 

jOCQUA  2  (U  Sub  jects) 

These  subjects  were  not  asked  to  give  an  initial  reference  point.  The 
subjects  were  merely  asked  to  assign  numbers  to  reflect  the  magnitude  of  the 
sensation. 

group  ^  no  Subleota) 

These  subjects  were  given  the  same  Instructions  as  Group  1  except  they 
were  told  to  assign  the  number  "100"  to  the  first  stimulus  position  (weights  at 
position  3}« 


DATA  ANALYSIS 


Starting  at  tha  oentar  holaa,  the  maaa  somant  of  inartla  for  aaoh  vaight 
poeitlon  vts  oaloulatad  In  InoD  Iba  nao^  aa  followa:  O.ISt  0.20,  0.29f  0.43» 
0.70,  1.15.  Tba  gaonatrlo  mean  of  aaoh  aubjaota*  threa  Judgaaianta  of  "top 
baavlnaaa*  waa  than  oa?.oulata<l  for  aaoh  of  tba  6  naaa  aonenta  of  Inartla. 

Othar  reaaaroh  on  paroaptlon  (2)  Indloataa  that  tha  aenaatlon  aagnltuda  growa 
aa  a  power  funotlon  of  tba  atlaulua  aagnltuda.  On  this  basis  tha  base  fit 
power  funotlon  relating  paroalvad  "top  haarlnass*  to  mass  aoaant  of  Inartla  was 
oaloulatad.  -The  orltarlon  was  alnlaal  suns  of  squared  deviations. 


Moment  c*  Inonu  (kwh  ■ 


Figure  2.  Soalad  Sensation  and  Corresponding  Haas  Moaant 
of  Inertia  for  four  Subjects 


Data  for  Group  2  have  baen  aztanalvaly  analyzed  and  are  abown  In  Figure  2 
tojvther  with  tbelr  beat  fit  line.  The  equation  for  tbla  line  averaged  aorosa 
aubjeota  la 

S  s  36.31 

where  S  «  perceived  "top  heaviness* 

I  s  mass  nonent  of  Inertia 

-There  was  surprisingly  little  variation  among  subjeots.  The  exponent  fur  each 
subject  was  1.00,  0.76,  1.2,  1.22. 

DISCUSSION 

Under  these  experimental  conditions  the  relationship  between  maas  moment 
of  inertia  and  sensation  was  approximately  linear.  The  power  function  1.06 
fits  within  the  range  of  exponents  found  In  scaling  experiments  for  other 
senses:  length  1.0,  pain  3*45,  loudness  0.67,  heaviness  1.45,  brightness  0.33 
to  1.0,  angular  aocelertlon  1.4,  cold  1.0,  and  warmth  1.6  (2).  The  sensation 
of  mass  moment  of  Inertia  may  be  perceived  to  Increase  less  rapidly  than  for 
heaviness,  tentatively  suggesting  that  increasing  the  heaviness  or  mass  of  a 
tool  assolated  with  a  manually  controlled  operation  may  be  more  noticeable  than 
Increasing  the  mass  moment  of  Inertia. 

These  results  will  be  useful  In  designing  handling  systems  where  trade-off 
decisions  might  have  to  be  made  conoernlng  the  relative  effects  on  perception 
and  task  performance  of  these  two  properties  and  In  designing  further  studies 
In  which  these  two  properties  may  be  studied  simultaneously. 

Future  plans  Include  the  following: 

1 .  Complete  analysis  of  all  present  data. 

2.  Perceptual  scaling  of  mass  and  of  amss  moment  of  Inertia  In 
larger  reach  envelopes. 

3.  Cross-modality  scaling  where  sub,1ects  will  be  asked  to  equate  the 
perceived  mass  moment  of  Inertia  of  one  set  of  stlimai  with  the 
perceived  mass  of  a  second  set. 
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ABSTRACT 

In  this  paper  we  describe  some  software  tools  developed 
recently  for  the  management  and  analysis  of  data  collected 
while  conducting  manual  control  experiments.  As  implemented, 
PROMAN  consists  of  four  major  stand-alone  modules  which 
perform  the  following  functions: 

EXPINT:  Interface  with  data  collected  from  the  experiment 

DBASE:  Data  Base  Organization  and  Management 

STAT2:  Perform  Statistical  Analysis 

MODINT:  Interface  with  model  matching/analysis  software 

Of  these,  the  DBASE  and  STAT2  are  general  purpose  modules.  The 
EXPINT  interface  will  be  tailored  to  the  format  in  which  experi¬ 
mental  data  are  collected.  The  MODINT  interface  will  be  tailored 
to  the  particular  model  matching  and  analysis  exercises  desired 
on  the  experimental  data. 

The  use  of  PROrdAN  will  be  illu.strated  with  reference  to  a 
specific  manual  control  experiment.  It  appears  thal,  PROMAN  can 
serve  as  an  extremely  useful  tool  for  manual  control  experiment 
data  base  management  and  analysis. 
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ABSTRACT 

- ‘  '/ 

'^Thls  paper  describes  a  program  currently  underway  Co  develop  telepresence 
sysceni/i  for  the  support  of  space  missions  such  as  satellite  maintenance  and 
repair.  A  force-reflecting,  dexterous  manipulator  system  is  emphasized  as  the 
basis. for  the  development,  of  integrated  telepresence  .systems. _  Alternate 
controllers,  control  implementations,  modified  end  effectors,  and  candidate 
vision  systems  will  be  evaluated  to  resolve  human-machine  design  issues.  — 

INTRODUCTION 

A  major  consideration  being  addressed  as  we  enter  the  Space  Shuttle  era 
concerns  the  extent  of  extra-vehicular  activity  (EVA)  to  perform  tasRs  in 
space  versus  remotely  operated  and  automated  systems.  Mission  analysis 
studies  have  identified  many  complex  tasks  which  will  be  required  in  the  areas 
of  satellite  services  and  space  construction  (Ref.  1).  There  are  numerous 
reasons  for  strongly  favoring  remotely  operated  and  automated  systems  for 
certain  applications.  These  reasons  Include  removal  of  the  astronaut  from  the 
vicinity  of  hazardous  operations  (such  as  transferring  propellant)  and  reduc¬ 
tion  of  the  non-productive  operational  time  associated  with  EVA. 

Remote  human  presence,  i.e.,  “telepresence”,  is  envisioned  as  the  needed 
capability  for  many  tasks  because  of  their  low  frequency  of  occurrence  and/or 
high  level  of  difficulty.  Telepresence  systems  provide  the  carabillty  to 
perform  difficult  operations  with  human  versatility  by  providing  “natural” 
control  interfaces,  vision,  and  Mechanical  arms  to  the  operator. 

The  evolution  of  space  telepresence  systems  from  the  present  conceptual 
stage  to  operational  flight  status  will  require  development  along  the  lines 
indicated  in  Fig.  1 ,  starting  with  ground-based  laboratory  tests  and  simula¬ 
tion  and  progressing  through  flight  demonstration  programs  leading  to  opera¬ 
tional  systems.  The  latter  will  Include  orbiter-attached  configurations, 
space  station  support  versions,  and  both  manned  and  unmanned  free-flying 
applications. 

Initial  studies  make  it  clear  that  current  technology  in  the  fields  of 
nuclear  energy,  underwater  exploration,  and  industrial  robotics  are  not 
sufficient  to  meet  the  needs  of  space  telepresence.  Technology  and  appli¬ 
cation  issues  were  identified  which  require  resolution  before  such  systems  can 
be  fully  developed.  Issues  such  as  tiie  tynz  of  concr'>llei'  needed,  control 
mode,  force  reflection  applicability,  working  volume,  time  delay  effects, 
number  of  arms,  and  degrees  of  freedom  must  be  addressed  before  operational 
systems  can  be  defined. 

The  key  to  developing  space  telepresence  technology  is  to  start  with 
manned  dexterous  manipulators  and  evolve  the  control  implementations,  vision 
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systems*  and  end  effectors  before  embarking  on  automated  systems.  Toward  this 
end*  a  Manipulator  Technology  Laboratory  was  established  to  Investigate  and 
resolve  telepresence  Issues.  An  electromechanical  master/slave  dexterous 
manipulator  system  was  built  based  on  design  requirements  derived  from  analy¬ 
sis  of  future  space  missions.  This  system  has  six  active  degrees  of  freedom 
with  a  manual  seventh*  bilateral  force  reflection*  and  automatic  counter¬ 
balancing.  The  2-meter-long  slave  arm  Is  more  than  three  times  larger  than 
the  master*  and  Indexing  capability  permits  operation  of  the  slave  arm 
throughout  Its  1100  ft’  working  volume  while  keeping  the  master  handle  within 
a  10-lnch  cube.  The  manipulator  slave  arm  is  the  basic  development  hardware 
around  which  telepresence  systems  are  being  built  and  tested. 

LABORATORY  tESTINC  APPROACH 


Initial  evaluations  have  emphasized  two  types  of  manipulator  system 
testing: 

*  Type  1  -  Quantitative  measurements  of  man-machine  performance  to 

eetabllsh  a  baseline  with  which  to  compare  future  Improved 
systems 

•  Type  2  -  Preliminary  applications  tasks  which  represent  the  kind  of 

operations  which  would  be  needed  for  on-orblt  missions. 

Type  1  testing  utilizes  a  task  board  (Fig.  2)  which  consists  of  ele¬ 
mentary  operations*  such  as  pushing  buttons*  for  which  performance  time  and 
accuracy  can  be  measured  (Ref.  2).  Type  2  testing  uses  standard  electrical 
and  mechanical  components  in  a  realistic  setting  to  evaluate  performance 
ability  in  a  more  qualitative  sense  than  does  Type  1  testing. 

TESTS  STATUS 


An  Initial  Type  1  test  series  using  12  test  subjects  has  been  completed. 
The  subjects  were  first  screened  for  distance  acuity*  depth  perception*  and 
color  discrimination.  Only  test  subjects  who  had  no  experience  with  manipu¬ 
lators  were  used.  After  a  short  briefing  on  system  operation  and  the  tests  to 
be  performed*  the  subjects  were  directed  through  a  series  of  20  trials  with  a 
S-mlnute  break  after  each  five-trial  segment.  Tests  were  conducted  with 
different  position  gains,  with  and  without  force  feedback*  and  for  both  direct 
and  black  and  white  closed-circuit  TV  viewing. 

Typical  results  for  one  test  subject  are  presented  In  Fig.  3  for  one  test 
condition.  A  learning  process  Is  observed  for  each  five-trial  segment  with 
average  task  times  about  equal  for  each  segment  but  with  average  error  reduced 
by  almost  a  factor  of  five  from  the  first  to  last  segment.  In  both  cases*  the 
standard  deviation  is  significantly  lower  in  the  later  trial  segments. 

Figure  4  presents  a  summary  of  the  same  test  for  four  different  test 
subjects  for  the  same  test  conditions  and  also  using  TV.  The  mean  times  and 
standard  deviations  are  only  for  the  last  five  trials*  which  represent  per¬ 
formance  after  an  Initial  learning  period.  In  three  out  of  four  cases, 
performance  degrades  (as  expected)  when  using  TV,  Task  time  standard 
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deviation  appears  to  Increase  for  TV  operation,  but  the  standard  deviation  of 
accuracy  generally  decreases  with  TV  uae.  The  latter  observation  is  probably 
due  to  Increased  operator  proficiency  rather  than  the  means  of  observing  tb? 
task  being  performed. 

FUTURE  PLANS 


Future  testing  is  expected  to  Include  the  following: 
e  Digital  control  manipulator  operations 
e  Improved  end  effectors 

e  Multiple-camera  vialon  systems  including  stereo 
e  Alternate  hand  controllers 
e  Improved  display  capability 
a  Arm-mounted  miniature  TV  cameras 
e  Mission  task  mockup  testing 
e  Supervisory  control  operation. 

Future  plans  also  Include  integrating  the  telepresence  system  with  a 
large-amplitude  motion  base  to  simulate  various  carrier  systems  and  operation¬ 
al  Interfaces. 
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SUMMARY  /• 

^pA  Sturdy  is  being  conducted  at  the^<jCAg-J-ar^»^ero apace  Medical 
Re8earc|^Lab,^«4ajfy-T— Wri-ght  Patteraon  Tllr-Porce  Base ,  0h4'$>  to 
investigate  different  types  of  stick  controllers  that  can  be  used  in  a 
complex  0  environment.  The  purpose  of  this  study  is  to  develop 
Impedance  models  to  show  the  biomechanical  effects  of  stick 
feedthrough  as  the  human  body  is  sub,Jected  to  low  frequency  G  stress 
fields.  These  impedance  models  will^extend  previous  work  developed  in 
the  vibration  area  preference bo  the  low  frequency  vibration 
fields  that  commonly  occur  in  modern  fighter  aircraft  (e.g.  th^ 
AFTI/F-16  with  lat3ral  acceleration  fields).  Another  purpose 
^ t ■’ dy  is  to  investigate  how  human  subjects  use  displacement  and  force 
feedbacks  in  side  arm  controllers.^ 

INTRODUCTION 


The  design  of  the  hand  controller  in  a  manual  tracking  situation 
may  substantially  influence  the  performance  characteristics  of  the 
closed  loop  man-machine  system.  In  a  previous  study  in  the  vibration 
environment  QO  ,  it  was  found  (figure  (l))  that  the  dynamics  of  the 
stick  controller  significantly  influenced  the  performance 
characteristics  of  the  closed  loop  system  under  a  variety  of  vibration 
disturbances.  For  example,  (figure  (t),  top  plot),  the  difference 
between  closed  loop  ef^^^g  tracking  scores  when  averaged  over  the  seven 
subjects  in  the  experiment  was  approximately  a  25^  change  in  tracking 
performance.  This  effect  (i.e.  the  controller’s  dynamic 
characteristics)  gives  rise  to  a  performance  decrement  which  is  an 
important  effect  to  be  considered  in  the  experimental  design.  A 
further  study  by  W.  H.  Levieon  investigated  these  impedance  models 
developed  in  the  vibration  area  by  computer  simulation  of  the  Optimal 
Control  Model  over  a  variety  of  different  stick  parameters  (  reference 
).  An  interesting  result  from  thie  study  was  the  existence  of  an 
optimal  electrical  gain  (top  plot  in  figure  (2))  which  minimized 
closed  loop  tracking  error  variance. 

As  it  has  been  demonstrated,  performance  can  vary  over  a  wide  range 
for  different  choices  of  stick  parameters  (figure  (2)).  The  next 
question  that  is  asked  is  how  much  further  is  it  possible  to  design 
stick  parameters  to  optimize  closed  loop  tracking  error  or  reduce 
feedthrough  effects?  From  observation  of  figure  (2),  it  appears  that  a 
reduction  in  stick  feedthrough  by  a  factor  of  about  2  might  be 
realized  from  the  adjustment  of  the  electrical  gain  characteristics. 

To  study  some  of  these  effects,  a  special  type  of  biomechanical  model 
was  developed  (reference  ^3^ )  for  lateral  acceleration  environments 
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which  occur  in  the  AFTI/F-16.  In  figure  (?),  a  description  of  the 
biomeohanioal  moael  is  given.  The  forearm  of  the  eubject  ia 
illustrated  and  moves  side  to  side  in  the  Y  direction.  The  wrist  of 

the  subject  is  at  the  point  where  the  forces  F^(t)  and  F2(t)  act  on 

the  stick.  The  stick  is  modeled  by  the  mass  Mg,  the  spring  Kg,  and  the 
damper  Bg  as  indicated  in  the  dotted  box.  The  objective  of  the  study 
reported  in  rsferenoe  CO  vas  to  make  the  beat  choices  of  Mg,  Bg,  and 

Kg  so  as  to  minimise  stick  feedthrough.  In  this  manner  it  ia  possible 

to  choose  stick  parameters  to  develop  a  minimum  feedthrough  stick.  The 
minimum  feedthrough  stick  mav  not  be  the  optimal  stick  in  the  sense  of 
best  performance  (minimum  tracking  error).  A  trade  off  may  exist 
betweeen  the  extreme  of  a  minimum  feedthrough  design  versus  the  other 
extreme  design  retiulrlng  excessive  control  forces  by  the  pilot.  Figure 
(4)  illustrates  the  results  of  the  computer  simulation  of  this 
biomechanical  model  for  different  choices  of  the  independent  variables 
Mg ,  Kg ,  and  Bg . 

In  figure  t4),  stick  feedthrough  H  (units  of  Degrees^  - 
displacement)  is  a  measure  of  the  stick  feedthrough  obtained  via 
computer  simulation  of  the  biomechanical  model  Illustrated  in  figure 
(?).  On  the  axis  Bg/Mg  *  constant  ~  0,  it  is  observed  that  a  minimum 
feedthrough  stick  appears  as  a  hybrid  combination  between  a  force 
stick  and  a  displacement  stick.  Quite  interestingly  enough,  the  stick 
feedthrough  is  reduced  to  a  level  of  at  the  minimum  but  achieves 

levels  one  or  two  orders  of  magnitude  higher  for  both  the  force  stick 
region  and  the  displacement  stick  region.  This  substantial  reduction 
of  feedthrough  indicates  the  existence  of  some  minimum  feedthrough 
designs  that  may  have  distinct  advantages  over  conventional  designs 
used  today.  Along  the  Kg/Mg  >  0  axis,  one  also  observes  that 
feedthrough  is  not  sensitive  to  the  parameter  Bg/Mg.  This,  quite 
interestingly,  concurs  with  results  obtained  in  reference  (cf.  plot 
2  on  figure  (2))  in  which  error  variance  is  very  insensitive  (the  plot 
is  very  flat)  to  stick  damping  over  a  range  of  two  orders  of 
magnitude.  From  the  early  work  of  W.H.  Levison  (figure  (2))  and  the 
results  of  the  biomechanical  simulation  (figure  (4)),  it  was  hoped  to 
design  a  study  involving  human  subjects  to  examine  the  effect  of 
different  stick  parameters  on  closed  loop  tracking  error. 

METHOD 

Design  of  the  Forcing  Function  -  A  zero  mean,  constant  variance,  sum 
of  sines,  disturbance  input  tracking  task  was  developed  consisting  of 
component  frequencies  ranging  in  value  from  .192  radians/second  to 
64.003  radians/sscond .  The  task  was  specially  designed  to  Investigate 
various  aspects  of  the  man-machine  system  based  on  frequency  spectrum 
characteristics  of  the  controller  that  would  effect  the  human's 
responses.  The  tracking  task  was  of  duration  163  seconds  and  the 
subjects  had  a  1  minute  rest  between  tracking  sessions.  All  of  the 
subjects  tracked  nine  tasks  each  day. 


Apparatus  -  An  F-4  aircraft  seat  was  situated  in  a  semi-isolated  room 
and  a  television  monitor  was  located  approximately  36  inches  from  the 
subject's  eyes.  The  subject  was  displayed  a  1  1/4  inch  wide  circular 
plpper  and  a  target  (cross)  of  equal  width.  The  subject  would  move  a 
side  arm  controller  in  the  lateral  direction  and  control  the  pipper  on 
the  inside  out  display.  The  control  slgnale  developed  in  the  loop  were 
sent  to  a  SEL  computer  for  storage  on  magnetic  tapes.  At  the  SEL 
computer,  the  system  being  controlled  (i/s  dynamics)  was  simulated  on 
an  analog  computer  diagram. 
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Subjects  -  Nine  subjects  participated  (8  male,  1  female)  in  part  I  of 
the  stick  study.  These  subjects  were  active  duty  Air  Force  members  of 
the  Acceleration  Panel  and  recaived  hazardous  duty  pay  for 
participation  in  centrifuge  experiments.  Their  ages  ranged  from  24 
years  to  39  years  and  they  had  a  variety  of  experience  to  both  G 
exposures  and  manual  tracking  tasks. 

Experimental  Design  Conditions 

Three  spring  gains  (denoted  as  WDS  (weak  displacement  stick),  SOS 
(strong  displacement  stick),  and  FS  (force  stick)  )  were  used  to 
generate  the  independent  variable  K3.  The  units  of  spring  gain  are 
pounds  force/dlsplacement  In  degrees  (figure  (3)).  Three  electrical 
gains  (or  display  gains)  were.  _u8_ed  to.vary._the  force,  charac  teristics 
versus  speed  of  the  target  on  the  screen  of  the  TV  monitor.  The  units 
of  the  electrlCAL  gain  are  volts/pound  (figure  (3)).  Each  subject  was 
required  to  track  for  3  days  of  data  collection  for  each  experimental 
condition.  On  each  data  day,  the  subject  would  have  one  stick 
configuration  and  track  9  runs  or  trials.  The  nine  trials  consisted  of 
the  3  electrical  gains  presented  randomly  3  times  each.  The  high 
electrical  gain  was  designed  to  be  over  sensitive,  the  mid  value  of 
electrical  gain  was  chosen  to  be  optimal,  and  the  low  electrical  gain 
was  designed  to  require  excessive  control  inputs.  The  presentation  of 
the  spring  gains  (Kg)  also  occurred  randomly  each  data  day. 

Training  Orientation  -  The  subjects  tracked  until  they  appeared  to 
show  asymptotic  performance  levels.  This  level  was  determined  as  less 
than  a  3$  change  in  RMS  error  scores  for  3  successive  data  days. 
Calculations  were  also  made  of  the  ratio  ff/jO  (standard  deviation  of 
the  3  replications  for  one  data  day  divided  by  the  mean  ej{ji3  score). 

If  this  ratio  was  of  the  order  of  0.1,  It  was  assumed  that  training 
was  asymptote. 

Results 

The  results  presented  herein  are  somewhat  preliminary  in  that  only 
part  I  of  this  experiment  was  completed  at  this  point  in  time  . 

Figures  6,7,8  illustrate  the  results  of  these  data  for  the  nine 
subjects,  the  three  spring  conditions,  and  the  three  electrical  gain 
conditions.  For  each  spring  condition,  (force  stick,  strong 
displacement  stick,  and  weak  displacement  stick),  the  three  electrical 
gain  conditions  are  illustrated  (G-1,  C>10,  and  G"90).  The  three  plots 
are  kept  on  separate  axes  because  a  G"1  plot  for  the  force  stick  gives 
rise  to  a  different  electrical  gain  (Kg)  than  G-1  for  the  strong 
displacement  stick.  What  is  interesting  to  note  is  that  the  electrical 
gain  G“10  appears  to  give  optimal  (lowest  epms  error  scores)  for  both 
the  force  stick  and  the  strong  displacement  stick.  This  result, 
however,  does  not  appear  to  hold  for  the  weak  displacement  stick  for 
data  averaged  over  the  nine  subjects. 

Since  the  greatest  variation  in  this  experiment  ie  due  to 
biodynamical  differences  in  the  subjects  (and  their  strength 
characteristics),  it  is  necessary  to  separate  out  the  intra-subject 
variability  (one  subject  all  conditions)  from  the  inter-subject 
variability  (all  subjects,  one  condition).  To  illustrate  the  effects 
of  the  spring  gains  of  the  stick  controller  on  one  subject,  figure  (9) 
is  representative  of  the  performance  scores  obtained.  The  learning 
data  in  figure  (9)  represents  the  three  sessions  prior  to  the  data 
colJ. action.  An  ANOVA  was  conducted  on  the  performance  scores  using  the 
electrical  gains  and  different  sticks  as  factors.  The  results  of  the 
ANOVA  and  a  Newman-Keuls  Multiple  Comparison  Test  Procedure 
(alpha"0.l)  for  all  9  subjects  are  illustrated  in  Table  I: 


Table  I  -  Nawman-Keuls  Multiple  Compariaon  Procedure  (alpha~Q.l) 


Electrical 

mean 

Gain 

G-10 
.4535  . 

G-90 
.4747  . 

G-1 

.  _.5795 

s .  d . 

.07b5 

.1519 

Electrical 

Gain 

G-10 

G-1 

G-90 

mean 

.3668 

.5871 

.8205 

8  e  d  e 

.  1  366 

.1^17 

.3315 

Electrical 

Gain 

G-1 

G-10 

G-90 

mean 

.6314 

.65223 

.9752 

s .  d . 

.4205 

Force  Stick 


Strong  Displacement 
Stick 


Weak  Displacement 
Stick 


*  Parameters  underlined  are  not  significantly  different. 

The  results  of  the  Newman*'Keuls  Multiple  Comparison  Test  as 
illustrated  in  table  I  indicate  for  the  force  stick  that  there  were  no 
significant  differences  in  mean  scores  due  to  the  change  in  the 
electrical  gain.  For  the  strong  displacement  stick  and  weak 
displacement  stick,  however,  the  mean  score  for  the  gain  conditon  G-90 
was  shown  to  be  significantly  different  from  the  other  two  gains. 

Summary  and  Conclusions 

A  study  was  conducted  on  different  types  of  stick  controllers  to  be 
used  in  G  environments  that  occur  in  modern  side  slip  vehicles.  A 
choice  of  3  electrical  and  3  spring  gains  were  used  with  teat  subjects 
from  the  centrifuge  panel.  From  this  investigation,  which  is 
exclusively  static  and  contains  no  G  disturbances,  the  stick 
parameters  influenced  tracking  performance  across  subjects  for  two  of 
the  three  sticks  considered.  These  results  show  high  variation  when 
averaged  over  all  9  panel  members:  however,  the  results  appear  to  show 
differences  when  averaged  across  replications  for  one  subject.  This 
high  Inter-subJect  variability  reported  here  may  be  due  to  wide 
va  iatlon  in  the  blodynamic  response  characteristics  of  the  pool  of 
subjects . 
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UOMPARISON  TO  VIBRATION  RESEARCH  -  TK-AO  -A008  533- 
‘‘BUIDE  FOR  THE  DESIGN  OF  CONTROL  STICKS  IN  VIBRATION 
ENVinONf^lENTS” 

-  IVilllani  H.  Levison.  ET.  AL.  Bolt  Boranok  and  Neuman 
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Flg\ire  (2)  -  Simulation  of  the  Optimal  Control  Model  for  different  electrical 
gains  and  spring  damping  characteristics  for  Impedance  models 
developed  under  vibration.  From  reference  [l]  . 
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SUMMARY 


. »An  experimental  six  degree-of-freedom  force-torque  sensor  system  has-been 
developed  at  ihe-Jet- Propul  si  on  Laboratory  (*PLV*and  inteorated  with  the  simu¬ 
lated  full-scale  Space  Shuttle  Remote  Manipulator  System  (RMS)  at  the  Johnson 
Space  Center, The  sensor  system  provides  data  on  forces  and  torques  act¬ 
ing  at  the  end  effector.  The  sensor  data  are  shown  to  the  operator  on  a  graphics 
display.  The  operator's  response  to  the  sensor  data  is  through  resolved  rate 
manual  control  of  the  RMS.  The  opening/closing  of  the  end  ^fwtor  is  also  in 
rate  control  mode.  Two  sets  of  control  experiments -lUva  baW*conducted  using 
force-torque  sensor  infonnation.  The  first  set  Involved  the  use  of  a  task 
board  equipped  with  Tool?  and  "modules'.  The  operator's  task  was  to  remove 
the  '*Tl(odules^*®from  their  holes  in  the  task  board  or  Insert  them  back  to  their 
holes.  The  removal  or  Insertion  of  one  of  the  modules  required  the  use  of  tools 
N  which  also  were  placed  in  holes  in  the  task  board.  The  second  set  of  experi- 
•'^'sjnents  involved  the  berthing  of  a  payload  Into  a  latching  mechanism  through  four,- — 
V-shaped  guides.  AltogeJIifiji^more  than  ififtjr  training  runs  and  iee- hundred 


recorded  test  runs  here 


-bedtW' 

iblisne 


er formed. 


preliminary  control  experiments 


were  successful  and  established  the  utility  of  the  force-torque  sensor  system 
for  geometrically  and  dynamically  constrained  operations.  The  sensory  feedback 
significantly  reduced  the  maximum  force  and  torque  loads  during  the  constrained 
operations  and  permitted  operational  techniques  that  were  perceived  as  •risky'* 
previously.  This  paper  briefly  describes  the  experlmcntal’sensor-end-effector- 
display^systemj^nd  the  control  experiments,  and  presents  a  brief  summary  of  the 
experimental  rr^ 


n^nd  tm 
•«ults. 


INTRODUCTION 


Motivated  by  future  space  application  requirements,  an  experimental  system 
was  developed  at  JPL  for  sensing  and  displaying  the  three  orthogonal  forces  and 
the  three  orthogonal  torques  acting  at  the  base  of  the  end  effector  (or  "hand")  of 
an  approximately  16  meter  (50  feet)  long  robot  arm  at  JSC.  The  arm  at  JSC  simu¬ 
lates  the  functions  of  the  Space  Shuttle  RMS.  The  experimental  system  contains 
the  following  main  components  and  capabilities: 

a)  Two  force-torque  sensors;  one  is  operating  in  the  0  to  100  lb  (0  to 
445  N)  range,  the  other  in  the  0  to  200  lb  (0  to  890  N)  range. 

b)  A  servo-controlled  end  effector  drive  system  using  a  brushless  DC 
torque  motor  in  position  or  rate  control  mode;  the  rate  control  can  be 
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proportional  or  preselected  fixed  rate  control. 

c)  An  interchangeable  three-claw  and  four-claw  end  effector,  interfaceable 
to  both  force-torque  sensors,  and  controllable  by  the  same  end  effector 
drive  system. 

d)  A  computer  graphics  terminal  for  displaying  the  acting  forces  and 
torques  to  the  operator  in  real  time;  the  graphics  display  is  pro¬ 
grammable  for  alternative  scales  and  formats,  the  selection  of  which 
can  be  controlled  manually  or  by  a  computer-recognized  voice  command 
system  in  real  time. 

e)  A  network  of  dedicated “microcomputers  supporting  the  sensor  data 
handling,  the  control  of  end  effector  drive  system,  the  graphics 
display  and  the  voice  command  system.  Capability  is  provided  for 
real-time  data  transfer  between  this  microcomputer  network  and  the 

SEL  32/35  minicomputer  in  the  JSC  Manipulator  Development  Facility  (MDF). 

f)  Control  input  peripherals  for  position,  fixed  rate  and  variable  rate 
control  of  the  end  effector. 

g)  An  eight-channel  analog  chart  recorder,  interfaced  to  the  microcom¬ 
puter  network,  for  recording  sensor  data  and  end  effector  status  for 
performance  evaluation. 

More  on  the  technical  details  of  the  "sensor-claw-display"  system  can  be 
found  in  Ref.  1.  The  "sensor-claw-display"  system  and  the  overall  experimen¬ 
tal  system  configuration  are  shown  in  Fig.  1. 

The  experimental  "sensor-claw-display"  system  has  been  integrated  with 
the  simulated  full-scale  Space  Shuttle  RMS  at  JSC  and  control  experiments  were 
conducted  for  geometrically  and  dynamically  constrained  manipulation  tasks. 

The  testing  and  evaluation  experiments  were  aimed  at  studying  the  enhancement  of 
the  Space  Shuttle  RMS  performance  in  operations  which  involve  manipulation 
tasks  with  narrow  geometric  and  dynamic  tolerances.  Such  tasks  are  involved 
in  operations  like  satellite  retrieval,  maintenance  and  repair,  in-orbit 
servicing  of  reusable  vehicles,  handling  of  large  payloads  which  may  require 
the  docking  of  large  masses,  assembly  of  structures  in  space,  etc. 


CONTROL  TEST  SCEN-' 

Two  sets  of  control  experiments  w.re  f-errormed  using  force-torque  sensor 
information.  The  first  set  of  tests  involved  the  use  of  a  task  board  equipped 
with  "tools"  and  "modules".  The  task  board  was  designed  and  built  at  JSC. 

The  second  set  of  tests  involved  the  berthing  of  a  payload  into  a  latching 
mechanism  through  four  guides.  The  payload  simulated  the  Plasma  Diagnostic 
Package  (POP)  under  zero  gravity  conditions. 

Task  Board  Tests 


The  "tool"  and  "module"  handling  task  board  is  shown  in  Fig.  2.  It  was 
placed  in  the  bay  of  the  Shuttle  mock-up,  about  8  meters  (25  feet)  from  the 


Shuttle  cockpit.  The  task  board  contained  (a)  a  box,  (b)  a  keyed  cylinder, 

(c)  a  screwdriver,  and  (d)  a  square-base  wrench.  To  accommodate  the  triangular 
and  quadrangular  grasp  geometries  of  the  three-  and  four-claw  end  effectors, 
two  sets  of  tools  and  modules  were  used:  one  set  with  triangular  handles  and 
another  set  with  quadrangular  handles.  The  surface  of  the  tool  handles  were 
coated  with  a  special  paint  providing  a  rough  surface  texture  In  order  to 
prevent  the  claws  from  slipping.  Each  end  of  the  tool  handles  were  also 
equipped  with  small  metal  cleats  helping  to  keep  the  claws  on  the  handles. 

The  tool  and  module  handling  tests  had  two  phases  of  manipulation  activl- 
tiss.  The  objective  of  the  first  phase  was  to  remove  the  keyed  cylinder  and 
box  from  the  task  board  and  place  them  aside.  Figure  3  Illustrates  the  first 
phase  manipulation.  The  cylinder  removal  did  not  require  the  use  of  tools,  but 
the  box  removal  did  as  Illustrated  in  Figure  4.  Before  box  removal,  the  box 
had  to  be  unlatched.  This  required  the  turning  of  two  retaining  latches,  each 
with  a  different  tool.  First,  the  screwdriver  was  removed  from  its  retaining 
hole  and  Inserted  into  the  head  of  the  upper  latch.  Then  the  latch  was  turned 
ninety  degrees  to  the  right  or  to  the  left,  and  the  screwdriver  was  removed 
from  the  head  of  the  latch  and  returned  back  to  its  retaining  hole.  Then  the 
wrench  was  removed  from  Its  retaining  hole  and  inserted  Into  the  head  of  the 
lower  latch.  The  latch  was  then  turned  ninety  degrees  to  the  right  or  to  the 
left,  the  wrench  was  removed  from  the  head  of  the  latch  and  returned  to  Its 
retaining  hole.  Thereafter  the  box  was  removed  and  set  aside.  This  completed 
the  first  phase  manipulation.  The  second  phase  manipulation  was  just  the 
reverse  of  this.  The  objective  of  the  second  phase  was  to  insert  the  keyed 
cylinder  and  box  back  to  their  retaining  holes  In  the  task  boardT  First  the 
box  was  picked  up  and  Inserted  Into  Its  retaining  hole.  The  two  latches  were 
then  turned  back  using  the  screwdriver  and  wrench  to  lock  the  box  Into  Its 
place.  Thereafter  the  keyed  cylinder  was  Inserted  Into  Its  retaining  hole  In 
the  task  board.  This  completed  the  second  phase  manipulation.  All  Insertion 
tolerances  on  the  task  board  were  6  mm  (0.25  inches). 

Payload  Berthing  Tests 

The  objective  of  the  payload  berthing  test  was  to  maneuver  the  simulated 
POP  payload  Into  a  retention  or  latching  mechanism  shown  In  Fig.  5.  The  latch 
assembly  was  placed  In  the  bay  of  the  Shuttle  mock-up  about  10  meters  (30  feet) 
from  the  Shuttle  cockpit  as  shown  In  Fig.  6.  The  berthing  tests  were  performed 
so  that  the  weight  of  the  mock-up  POP  payload  (about  250  1b)  was  counterbal¬ 
anced  through  a  pulley  attached  to  an  overhead  crane  as  also  seen  In  Fig.  6. 

In  this  way  the  only  forces  and  torques  generated  at  the  force-torque  sensor 
were  those  caused  by  the  payload  contact  with  the  latch  assembly.  The  counter¬ 
balance  arrangement  allowed  all  small  translational  and  rotational  movements 
of  the  manipulator  necessary  for  the  tests.  The  tests  started  with  lowering 
the  guide  pins  of  the  POP  payload  to  the  point  that  they  were  almost  touching 
the  V-shaped  guides  of  the  latching  mechanism. 

The  latching  mechanism  consists  of  four  V-shaped  guides  as  shown  In  Fig.  5. 
Two  are  on  the  forward  end  of  the  mechanism,  and  two  are  on  the  port  side. 

Three  microswitches  (labeled  A,  B  and  C  In  Figure  5)  are  closed  whenever  the 
payload  Is  level  and  touching  the  bottom  of  the  guides.  Three  Indicators 
Inside  the  flight  deck  area  of  the  cockpit  indicate  the  on-off  state  of  the 
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three  microswitches.  To  latch  safely  requires  that  all  three  microswitches 
are  on.  This  in  turn  requires  a  simultaneous  contact  at  points  A,  B  and  C. 
After  simultaneous  contact  th®  payload  Is  latched  by  a  motor  which  pulls  it 
aft  along  the  horizontal  notch  In  the  guides  and  locks  It  in  place.  It  is 
noted  that  the  location  {A,  8  and  C)  of  the  three  microswitches  Is  Invisible 
to  the  operator  once  the  payload  guide  pins  are  Inside  the  V-shaped  guides. 

The  Initial  placement  of  the  payload  during  the  test  runs  contained  some 
small  translational  and/or  rotational  misalignments  relative  to  the  V-shaped 
guides  and  relative  to  the  contact  plane  of  the  latch  assembly  as  shown  In 
picture  (a)  of  Figure  7.  Consequently,  during  a_  "down."  motion  of  the  MDFL  arm, 
some  of  the  payload  gulde  pins  contacted  the  Inside  edge  of  the  V-shaped  guides 
generating  undeslred  contact  forces  and  torques  betv.ccn  the  payload  and  the 
latch  assembly.  This  can  lead  to  (a)  an  unevef*  contact  between  the  payload  and 
the  bottom  plane  of  the  latch  assembly  preveiting  the  simultaneous  closing  of 
all  three  (A,  B  and  C)  microswitches  in  th'.  contact  plane,  (b)  overloading  the 
latch  assembly,  or  (c)  jamming  the  payload  gu  ide  pins  Into  the  V-shaped  guides. 
Ideally,  only  a  small  "down"  force  should  be  acting  between  the  pay’ cad  and 
the  latch  assembly  at  the  terminal  contact,  and  all  lateral  forces  and  all 
torques  should  be  zero  or  near  zero.  Pictures  (a),  (b)  and  (c)  of  Fig.  7 
show  a  full  berthing  sequence. 


INFORMATION  AND  CONTROL  CONDITIONS 

The  operator  had  three  basic  sources  of  Information  for  guiding  and  con¬ 
trolling  the  RMS  during  the  tests:  (a)  direct  visual  access  to  the  scene  through 
the  cockpit  windows,  (b)  two  closed  circuit  TV  monitors  showing  the  scene  sel¬ 
ectable  from  several  TV  cameras  located  on  the  wrist  and  elbow  of  the  RMS  and 
around  the  cargo  bay  area  of  the  Shuttle  mock-up,  and  (c)  a  graphics  display 
of  the  force-torque  sensor  information. 

The  basic  RMS  control  was  manual  us'ing  two  three-dimensional  hand  control¬ 
lers  for  RMS  control  In  resolved  rate  control  mode:  one  hand  controller  (opera¬ 
ted  by  the  left  hand,  see  Fig.  8)  controls  the  three  translational  components 
of  RMS  end  effector  motion,  the  second  hand  controller  (operated  by  the  right 
hand,  see  Fig.  8)  controls  the  three  rotational  components  of  RMS  end  effector 
motion.  The  on-off  switch,  which  controls  tlic  opening  and  closing  of  the  RMS 
end  effector,  was  replaced  with  a  linear  potentiometer  arrangement  p»"Ov1d1ng 
proportional  rate  control  capability  for  opening  and  closing  the  claws. 

The  direct  visual  and  TV  Information  sources  and  the  basic  RMS  control  are 
Shuttle  baseline  arrangements.  The  graphics  display  and  the  proportional  claw 
control  were  specifically  developed  for  the  force-torque  control  experiments. 

Graphic  Display 

The  forces  and  torques  measured  by  the  sensor  at  the  base  of  the  daws 
were  displayed  to  the  operator  on  a  9-1nch  B/W  monitor  in  graphics  format. 

This  monitor  was  mounted  to  the  right  the  TV  monitors  as  shown  in  Fig,  8. 

The  graphics  display  generator  used  In  the  present  experimental  system  has  a 
resolution  of  512  by  512  pixels  and  Is  capable  of  displaying  up  to  eight  colors. 
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(The  color  capability  was  not  used  since  the  baseline  flight  deck  monitors  are 
B/W.) 

The  Initial  format  chosen  for  displaying  forces  and  torques  Isa  very 
simple  "bar  chart"  display,  and  a  rotating  two  dimensional  vector.  The  bars 
are  arranged  horizontally  In  the  upper  half  of  the  screen  (see  the  top  of  Fig. 
1).  Each  bar  corresponds  to  one  of  the  six  forces  and  torques.  If  there  Is 
a  positive  force  or  torque,  the  bar  elongates  to  the  right.  A  negative  force/ 
torque  causes  the  bar  to  extend  out  to  the  left.  There  are  vertical  grid  mark¬ 
ings  on  the  screen  to  enable  quick  estimation  of  the  applied  forces.  Under¬ 
neath  each  vertical  grid  line  Is  a  number  Indicating  the  corresponding  force 
or  torque.  This  scale  may  be  changed  either  from  the  users  console,  or  by 
voice  command.  In  addition,  by  a  keyboard  or  by  voice  the  user  may  cause  each 
force  and  torque  to  be  labeled  indicating  whether  It  is  an  X,  Y,  or  Z  force  or 
torque  and  what  Its  exact  numeric  value  Is.  Currently  the  forces  and  torques 
are  shown  only  In  the  reference  frame  of  the  sensor,  although  the  axis  may  be 
labeled  as  desired  by  the  user  via  commands  to  the  display  computer.  The  sen¬ 
sor  reference  frame  Is  shown  In  Fig.  9  in  relation  to  the  four-claw  end  effec¬ 
tor  geometry. 

Beneath  the  force/torque  bar  chart  display  appears  the  last  word  recog¬ 
nized  by  the  voice  recognition  system.  The  word  blinks  If  the  voice  system  Is 
active. 

To  the  right  of  this  word  display  Is  a  small  two  dimensional  vector  and 
coordinate  system  that  shows  the  direction  and  magnitude  of  the  resultant 
of  the  two  forces,  orthogonal  to  the  end  effector  roll  axis  as  It  would  appear 
If  viewed  through  the  TV  camera  mounted  on  the  end  effector.  The  position  of 
the  tip  of  the  vector  Is  Indicated  by  a  small  cross  to  enhance  visibility. 
Adjacent  to  this  Is  a  vertical  line  Indicating  the  direction  and  magnitude  of 
the  force  along  the  end  effector  roll  axis.  If  It  extends  upward,  the  wrist 
lorce  is  a  push.  If  It  extends  downward,  the  wrist  exerts  a  pulling  force. 

This  line  and  the  2D  vector  Is  biased  and  scaled  with  the  same  commands  that 
apply  to  the  bar  chart. 

At  the  bottom  of  the  screen  are  horizontal  bars  Indicating  the  position 
of  the  claw.  As  the  claw  Is  closed  the  bars  extend  toward  the  center  of  the 
screen.  When  the  claw  Is  fully  closed  It  appears  as  a  solid  horizontal  bar 
on  the  display. 

Existing  forces  and  torques  measured  by  the  sensor  at  the  base  of  the 
claws  can  be  biased  out  from  the  readings  shown  on  the  display  (setting  them 
to  zero)  at  any  time  and  for  whatever  position/orientation  the  end  effector 
Is  In  at  that  particular  time.  Using  this  display  biasing  capability  Just 
before  an  object  held  by  the  end  effector  comes  In  contact  with  the  environ¬ 
ment  enables  the  operator  to  see  the  actual  contact  forces  and  torques  on  the 
display.  This  display  biasing  capability  In  effect  simulates  zero  gravity 
conditions  for  payload  handling  tasks  at  the  moment  when  contact  between  pay- 
load  and  environment  Is  established.  The  display  can  be  unbiased  at  any  time. 
The  unbias  command  will  cause  the  true  forces  and  torques  acting  on  the  end 
effector  (including  gravity)  to  be  displayed.  The  "bias"  and  "unbias"  display 
commands  can  be  activated  manually  (by  a  push-button  switch  or  a  TTY  key)  or 
by  voice. 
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Claw  Control 


Three  methods  were  Implemented  for  controlling  the  closing/ope;iing  of  the 
end  effector  claws:  position  control,  fixed  rate  and  proportional  rate  control. 
Position  control  was  achieved  with  a  three-turn  potentiometer  mounted  in  a 
small  box  and  placed  next  to  the  flight  deck  window,  (this  box  also  housed  the 
push-button  switch  for  controlling  display  "bias".)  The  operator  could  simply 
dial  in  the  amount  of  closure  he  wanted  the  claw  to  assume.  When  the  c’k^'ws 
reached  the  desired  position,  the  brake  on  the  end  effector  drive  motor  ms 
automatically  set,  and  the  motor  turned  off  automatically. 

Fixed  rate  control  was  implemented  by  using  a  thumb  switch  for  selecting 
the  desired  rate  and  accepting  the  close/ open  commands  from  the  rocker  switch 
mounted  on  the  standard  RMS  flight  model  orientation  control  joystick.  The 
thumb  switch  was  mounted  to  the  same  box  which  housed  the  three- turn  potentio¬ 
meter  for  position  control.  Fixed-rate  control  was  not  used  during  the  tests. 


The  predominantly  used  control  for  claw  opening/closing  was  the  propor¬ 
tional  rate  control  mode.  This  was  implemented  by  modifying  a  copy  of  the 
standard  RMS  flight  model  orientation  control  joystick.  The  rocker  switch  was 
replaced  with  two  linear  potentiometers  with  about  2  cm  (0.75  inches)  travel. 
One  was  mounted  above  the  other.  The  upper  trigger  was  for  opening  the  claws, 
the  lower  one  was  for  closing.  The  opening  trigger  was  equipped  with  a  safety 
cover  to  preclude  accidental  opening.  Motor  velocity  was  proportional  to  the 
distance  the  trigger  was  pulled  in.  The  triggers  were  spring  loaded  so  that 
they  would  return  to  zero  position,  and  the  motor  would  stop  moving  if  the 
both  triggers  were  released.  An  exception  to  this  was  in  the  "grasp"  mode 
where  a  constant  grasp  force  would  be  applied  to  the  tool  after  trigger  release 
if  the  operator  had  commanded  a  maximum-travel  closing.  This  grasp  force 
would  be  applied  to  the  tool  handle  until  the  operator  issued  an  open  command. 


TEST  RUNS  AND  DATA 

More  than  50  training  runs  and  110  recorded  test  runs  have  been  performed 
by  four  test  operators.  The  force- torque  sensor  and  claw  open/close  position 
data  were  recorded  in  both  analog  and  digital  formats.  An  eight-channel  strip 
chart  recorder  was  used  to  record  either  the  three  force  and  three  torque 
components  plus  the  claw  position,  or  the  eight  raw  (unconverted)  strain 
gage  readings. 

The  force-torque  sensor  and  claw  open/close  position  data  in  digital  form 
were  sent  to  the  JSC  MDF  SEL  32/35  minicomputer  over  a  serial  line  as  a  set  of 
signed  decimal  ASCII  numbers.  Each  set  of  readings  is  separated  by  carriage- 
return.  Data  is  buffered  at  a  rate  of  approximately  5  to  6  Hz  In  the  memory 
of  the  M6809  graphics  control  microcomputer  until  it  could  be  sent  to  the 
SEL  32/35  and  to  the  hardcopy  printer.  Data  buffering  was  necessary  since,  in 
the  worst  case,  the  real-time  data  can  be  changing  faster  than  the  serial 
transmission  line  can  accept  the  data.  The  time  of  day  to  the  nearest  second 
was  appended  to  the  data  since  in  some  cases  2  to  3  minutes  of  data  had  been 
buffered  up  before  the  SEL  32/35  could  accept  the  data  through  the  serial 
transmission  line. 
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The  time-dating  of  the  F-T  sensor  data  allows  correlating  the  F-T  sensor  data 
with  the  other  RMS  data  recorded  by  the  SEL  32/35  for  performance  evaluation. 
The  digital  data  records  (either  force- torque  information  or  raw  strain  gage 
readings)  can  also  be  displayed  in  real  time  on  a  CRT  console  connected  to 
the  M6809  graphics  control  microcomputer. 

Familiarization  Phase 


Four  test  operators  performed  familiarization  runs  for  about  a  week. 

These  runs,  which  were  distributed  over  a  three  week  time  period,  were  neces¬ 
sary  since  the  use  of  the  force- torque  sensor-claw-display  system-in  manual 
control  of  a  large  and  flexing  robot  arm  represented  a  very  first  and  unique 
experience  to  everyone  Involved  In  the  tests. 

The  operators  had  to  learn  about  several  aspects  of  the  new  sensor-claw- 
display  system:  (1)  The  nature  and  functional  meaning  of  the  multidimensional 
force-torque  sensor  information;  three  orthogonal  force  and  three  orthogonal 
torque  components  are  simultaneously  displayed  to  the  operators.  (2)  Corre¬ 
lating  the  force  and  torque  components  displayed  in  alternative  reference 
frames  (sensor/claw  or  orbiter  coordinates  --  see  Fig.  9)  with  the  use  of  the 
two  three-dimensional  joystick  controls.  (3)  Correlating  the  displayed  force- 
torque  information  and  the  joystick  control  Inputs  with  the  task  control  at 
hand;  this  involved  the  mental  Integration  of  visual  and  graphically  displayed 
force- torque  sensor  Information  and  the  calibration  of  joystick  control  inputs 
with  the  dynamic  response  of  the  system  as  seen  on  the  force-torque  sensor 
graphics  display.  (4)  The  use  of  the  new  position  and  rate  controls  of  the 
claw;  as  a  consequence  of  the  training  runs,  only  proportional  rate  control 
was  used  for  controlling  claw  opening/closing  during  the  tests  because  of  its 
flexibility.  (5)  The  difference  in  the  visual  geometric  reference  for  using 
force-torque  sensor  Information  with  the  three-claw  and  four-claw  end  effector; 
again,  as  a  consequence  of  the  training  runs,  only  the  four-claw  end  effector 
was  used  during  the  tests  because  of  Its  Inherent  quadrangular  syrmietry. 

As  a  result  of  the  familiarization  phase,  the  original  test  run  matrix 
was  limited  to  the  small  payload  berthing  and  task  board  test  scenarios. 

Payload  Berthing  Test  Data 

The  test  scenario  and  the  operator's  control  tasks  related  to  payload 
berthing  were  described  in  a  previous  section.  For  control  reference,  the 
Orbiter  Body  Reference  Frame  (see  Fig.  9)  was  used.  The  berthing  tests  were 
performed  under  three  diferent  Information  feedback  conditions. 

A)  Sensor  displ.-ty  only:  the  operator  had  only  access  to  the  graphic/ 
numeric  display  of  the  force-torque  sensor  information;  the  cockpit 
window  was  blocked,  and  the  TV  monitors  were  turned  off. 

B)  Visual  access  only:  the  sensor  display  was  turned  off,  and  the 
operator  had  to  rely  on  direct  vision  and/or  TV  information  only. 


C)  Sensor  display  and  visual  access  simultaneously:  the  operator  had 
visual  (direct  vision  and/or  TV)  access  to  the  task  scene  aind 
could  also  see  the  graphi c/numeric  display  of  force-torque  sensor 
information. 

The  operators  had  to  perform  twelve  payload  berthing  test  runs  in  one 
setting,  four  runs  for  each  of  the  three  (A,  B  and  C)  information  feedback 
conditions.  The  information  feedback  condition  sequence  was  predetermined 
for  a  twelve-run  setting,  but  the  operators  did  not  know  under  what  informa¬ 
tion  condition  the  next  test  run  willbe. performed. — Each- operator  had  to 
-repeat  a  twelve-run  setting  three  times,  preferably  on  three  different  days, 
or  one  in  the  a.m.  and  another  one  in  the  p.m.  of  the  same  day.  Because  of 
time  and  subject  availability  constraints,  only  two  of  the  four  test  opera¬ 
tors  were  able  to  complete  the  full  thirty-six-run  test  plan  for  payload 
berthing.  Their  average  time  performance  data  are  shown  in  Table  1.  Typical 
force-torque  time  histories  recorded  on  the  analog  strip  chart  recorder  during 
the  payload  berthing  test  runs  are  shown  in  Figures  10  and  11. 

The  mean  time  data  shown  in  Table  1  should  only  be  interpreted  as  indi¬ 
cative  rather  than  conclusive  since  (a)  the  data  base  upon  which  the  mean  times 
were  computed  is  statistically  narrow,  and  (b)  the  time  performance  is  depen¬ 
dent  on  the  overall  hardware  configuration  employed  in  the  tests.  Neverthe¬ 
less,  Table  1  and  Figures  10  and  11  show  a  few  significant  points: 

(1)  The  most  interesting  result  is  that  all  operators  consistently  could 
perform  the  payload  berthing  without  any  visual  feedback,  relying 
only  on  graphics  display  of  force-torque  sensor  information  during 
the  terminal  phase  of  berthing  when  the  payload  guide  pins  were  inside 
the  V-shaped  guides  of  the  latch  assembly.  However,  operator 
comments  indicated  the  desirability  of  having  some  visual  access  to 
the  RMS  and  the  task  scene. 

(2)  Using  graphics  display  of  force-torque  sensor  information  for 
guidance,  the  operators  could  successfully  control  the  excess 
contact  forces  and  torques  during  the  terminal  phase  of  the  payload 
berthing  task. 

(3)  Without  graphics  display  of  force-torque  sensor  Information,  using 
only  visual  feedback,  the  operators  had  no  iuea  about  the  magnitude 
and  location  of  contact  forces  and  torques  generated  during  payload 
berthing  (see  the  lower  part  of  Fig,  11),  though  the  latching  was 
successfully  accomplished, 

(4)  The  time  data  indicate  that  the  force-tcrque  sensor  information  may 
contain  more  relevant  guidance  data  than  the  visual  information  dur¬ 
ing  the  terminal /contact  phase  of  the  payload  berthing  task,  since 
the  average  time  under  condition  A  is  shorter  than  under  condition  B 
(see  Table  1) . 

(5)  The  time  data  also  indicate  that  the  use  of  more  sensory  information 
(that  is,  the  simultaneous  use  of  visual  and  Graphics  display  of 
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force-torque  sensor  Information)  may  lead  to  longer  performance 
time  unless  the  information  is  properly  coordinated  in  order 
to  ease  the  operator's  perceptive  workload.  Note  that  the 
average  time  under  condition  C  is  longer  than  under  conditions 
A  and  6  (see  Table  1). 

It  is  worth  noting  two  facts:  (a)  The  time  data  shown  in  Table  1  are  re¬ 
lated  to  10  to  12  cm  (4  to  5  inches)  total  travel  of  the  payload.  This  indi¬ 
cates  that  the  terminal /contact  phase  of  the  payload  berthing  task  is  a  time 
_consum1ng_operation.  .(b)__There  _1s_a  considerable  spread  of  perfomance  times 
around  the  mean  time  (see  max.  and  min.  times  In  Table  1).  This  Indicates 
that  minor  variances  In  the  initial  conditions  (that  is,  minor  variances  in 
the  appraoch  conditions  to  the  V-shaped  guides  of  the  latch  assembly)  and  minor 
control  performance  variations  have  a  considerable  impact  on  performance  time. 

Task  Board  Test  Data 


The  test  scenario  and  the  operator's  control  tasks  related  to  "module" 
and  "tool"  handling  on  a  task  board  were  described  in  a  previous  section. 

For  control  reference,  the  Sensor/Claw  Reference  Frame  (see  Fig.  9)  was  used. 
The  nature  of  the  control  tasks  required  that, for  guidance/control  Information, 
the  operators  have  access  to  all  three  Information  sources  all  the  time:  direct 
vision,  TV  cameras/monitors  and  graphics  display  of  force-torque  sensor  infor¬ 
mation. 

As  described  previously,  a  full  "tool"  and  "module"  handling  test  had 
two  phases:  (A)  removing  the  modules  from  the  task  board  and  (B)  reinserting 
the  modules  back  to  their  retainers  In  the  task  board.  Each  phase  contained 
twenty-five  subtasks.  For  Phase  B  (reinsertion  of  modules)  the  sequence  of 
subtasks  is  listed  in  Table  2.  Test  data  were  only  taken  for  Phase  B  manipu¬ 
lation  activities. 

Altogether  sixteen  Phase  B  test  runs  have  been  performed  by  four  opera¬ 
tors  with  recorded  performance  data.  The  mean  times  for  each  of  the  twenty- 
five  subtasks,  as  listed  in  Table  2,  are  computed  from  ten  test  runs  only 
since  the  sequence  of  subtasks  in  the  other  six  test  runs  was  somewhat 
different;  the  sequence  of  using  the  "red"  and  "blue"  tools  was  there  Inter¬ 
changed.  (The  "red"  tool  is  the  "screwdriver",  the  "blue"  tool  is  the  square- 
head  "wrench".)  Typical  force-torque  time  histories  recorded  on  the  analog 
strip  chart  recorder  during  the  "module"  and  "tool"  handling  test  runs  are 
shown  in  Figures  12  and  13. 

The  data  shown  in  Table  2  are  not  comparative  in  nature  since  all  test 
runs  were  performed  under  identical  Information  feedback  conditions.  The 
same  tests  were  planned  with  visual  feedback  only,  but  the  available  time 
did  not  allow  it.  The  data  in  Table  2  should  therefore  be  interpreted  as 
indicative  regarding  the  distribution  of  performance  times  among  the  sub¬ 
tasks.  Note  also  the  spread  of  performance  times  (max.  and  min.  time  in 
Table  2)  for  a  subtask. 
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Note  that  the  most  time  consuming  subtasks  are  the  Insertions  of  the 
box  and  cylinder  "modules".  These  are  the  riskiest  subtasks  where  jamming 
can  easily  occur.  Jamning  occurs  when  the  force  applied  In  the  direction  of 
Insertion  no  longer  causes  the  Insertion  to  proceed.  When  jamming  occurs, 

It  Is  possible  to  cause  deformation  of  parts  by  the  applied  force.  In  general, 
janwilng  Is  caused  by  moving  the  direction  of  the  applied  force  outside  certain 
bounds  (Ref.  2).  The  graphics  display  of  force-torque  sensor  Information  was 
most  useful  for  preventing  jamming  during  box  and  cylinder  Insertion,  Illus¬ 
trated  In  Fig.  12.  The  large  amplitude  variations  In  the  Fz  force  shown  In 
the  upper  and  lower  part  of  Fig.  12  Indicate  situations  where  jamming  could 
have  occurred.  The  time  history  of  the  Fz  force  variations  shows  that  the 
-operator  prevented  the  jamming  and  successfully  completed  the  box  and  cylinder 
Insertions. 


CONCLUSIONS  AND  PLANS 

The  preliminary  tests  established  the  utility  of  the  graphically  dis¬ 
played  force- torque  sensor  information  for  geometrically  and  dynamically  con¬ 
strained  operations  with  a  large  and  flexing  robot  arm  simulating  the  func¬ 
tions  of  the  Shuttle  RMS  since: 

(1)  The  sensor  system  feedback  helped  In  significantly  reducing  maximum 
force  and  torque  loads  generated  during  the  simulated  RMS  operations. 

(2)  The  sensor  system  feedback  permitted  operational  techniques  with  the 
simulated  RMS  that  were  perceived  previously  as  marginally  acceptable 
or  completely  unacceptable. 

Thus,  the  force-torque  sensor  system  can  be  a  significant  aid  In  providing 
force- torque  Information  fo.  sensitive  RMS  operations. 

The  future  plans  Include:  (a)  Integration  of  visual  and  force-torque 
sensor  graphics  display  Information.  This  can  take  several  forms;  for  Instance, 
superimposing  the  graphics  display  on  the  TV  pictures  and/or  having  a  small 
plasma  display  at  the  fllqlit  deck  windows,  (b)  Development  of  task-related, 
more  concire  and  "Intelligent"  display  formats  to  ease  the  operator's  percep¬ 
tive  and  decision  Lurden.  (c)  Development  of  an  experimental  control  system 
for  using  the  force-torque  sensor  information  In  an  Interactive  manual/auto¬ 
matic  control  mode,  (d)  Conducting  further  performance  evaluation  experiments. 
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Table  1.  Time  Performance  Data  of  Payload  Berthing 
Tests 


V  Operators 

Operator  No.  1 

i 

Operator  No.  2 

Overall 

Average 

Time 

InformatlorNv,^^ 
Condition  n. 

max. time 

mtn.time 

max. time 

mean  time 

min. time 

A 

3:58 

1:^10 

0:39 

4:33 

2:^19 

1:27 

2:14 

B 

4:10 

0:48  2:11 

5:27 

1:46  ^*^2 

2:44 

C 

3:48 

2:13 

0:44 

7:27 

^;16 

2:39 

3:14 

time  In  [min: sec] 


A:  only  force-torque  sensor  display 
B:  only  visual  (direct  and/or  TV)  feedback 
C:  both  visual  and  sensor  display  feedback 

Note;  each  "mean  time"  1$  computed  from  twelve  test  runs 
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Figure  1.  Serrsor-Claw-Display  System  and  Overall  Experimental 
System  Configuration 
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Figure  11.  Typical  Performance  Data  for  Cases  When  a)  Both  Visual  and 

Graphics  Display  of  Force-Torque  Sensor  Data  Were  Used  (Upper 
Figure),  and  b)  Only  Visual  Information  was  used  (Lower  Figure) 
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Figure  12. 
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Typical  Task  Board  Performance  Data 

a)  Cylinder  Insertion  (Upper  Figure 

b)  Box  Insertion  (Lower  Figure) 
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Figure  13.  Typical  Task  Board  Performance  Data: 

a)  Latch  Turning  with  Flat  Head  Tool  (Upper  Figure) 

b)  Latch  Turning  with  Square  Head  Tool  (Lower  Figure) 
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Abstract 

The  proposed  research  will  examine  the  use  of  an 
integrated  controller  for  the  primary  flight  control  of  a 
helicopter.  The  primary  controls  of  pitch,  roll,  and  yaw 
will  be  integrated  into  a  single,  side>stick  controller. 
Two  types  of  integrated  controllers  will  be  studied:  1)  an 
isotonic  (displacement)  controller;  and  2)  an  isometric 
(force)  controller.  The  two  integrated  control  configura¬ 
tions  will  be  compared  to  the  conventional  arrangement  via 
performance  on  a  3-axia  compensatory  tracking  task.  RMS 
error  will  provide  the  dependent  measure. 


Introduction 

Helicopters  are  being  employed  in  an  increasingly  wide 
range  of  civil  and  military  applications  due  to  their 
unique  flight  capabilities.  These  are  functions  which 
fixed-wing  aircraft  either  cannot  do  or  cannot  do  very 
well.  These  functions  include  such  things  as  low  level 
contour  flying,  precision  hovering,  and  landings  in  con¬ 
fined  areas.  These  demanding  maneuvers  translate  into 
high  levels  of  pilot  workload  and  fatigue.  Advancements 
in  helicopter  technology  will  roost  likely  result  in 
increased  automation  of  flight  control  functions  and  more 
on-board  avionics  which  will  provide  some  assistance  in 
pilot  decision  making  and  navigation.  Even  with  this 
added  assistance,  manual  piloting  will  continue  to  be  of 
utmost  importance.  Therefore,  any  improvements  in  hel¬ 
icopter  cockpit  or  controls  design  will  enhance  the  exist¬ 
ing  flight  capabilities  as  well  as  maintain  pilot  workload 
and  fatigue  at  a  minimum. 

In  the  present  day  helicopter,  the  control  system 
consists  of  three  primary  elements;  the  cyclic,  collec¬ 
tive,  and  rudder  (tail  rotor).  The  cyclic  is  center-floor 
mounod  and  controls  airspeed,  pitch,  and  roll  utilizing 
the  right  hand  in  a  fore-aft  and  slde-to-side  motion.  The 
collective  is  left-side  floor  mounted  and  directs  changes 
in  altitude,  utilizing  the  left  hand  in  an  up-down  motion* 
The  rudder  controls  yaw  movement,  counteracting  the 
effects  of  torque  and  controlling  heading  in  hover  manuev- 
srs,  and  is  controlled  by  the  feet  in  a  pushing  motion. 

Although  this  represents  the  historical  and  current 
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configuration#  it  may  not  prove  desirable,  particularly  in 
high  demand  flight  situations.  Both  hands  and  feet  are 
very  active  bacause  of  the  frequent  control  activity 
required  in  these  situations.  In  addition  to  the  fact 
that  the  pilot  is  totally  involved  with  the  flying  task# 
this  activity  is  conducted  from  an  awkward  posture.  The 
pilot  is  leaning  left  to  actuate  the  collective#  leaning 
forward  for  visibility#  the  arm  is  bent  in  front  for  the 
cyclic#  and  the  knees  are  flexed  to  control  the  pedals; 
t bus  “  an  “  uncora  f o  r  t abi  e^  po  s fur  e“  t b  m a  i  hfa  i  n  f b  r  “  ah y  1  eng  th 
of  time.  A  frequent  complaint  from  helicopter  pilots  who 
have  flown  for  a  considerable  time  is  severe  back  pain; 
the  incidence  of  which  is  well  documented.  Other  benefits 
resulting  from  the  implementation  of  an  integrated  con¬ 
troller  would  be  more  efficient  use  of  cockpit  space#  and 
a  quicker  escape  from  the  cockpit  if  a  situation  should 
require  it. 

A  need  clearly  presents  itself  to  consider  an  alter¬ 
native  configuraMon  in  an  attempt  to  alleviate  the  prob¬ 
lems  associated  with  this  control  arrangement.  The  pro¬ 
posed  solution  is  an  integrated  controller#  wherein  the 
primary  control  functions  {omitting  altitude  in  the 
present  case)  are  combined  into  a  single  side-stick  con¬ 
troller.  Two  versions  of  the  integrated  controller  will 
be  compared  with  the  conventional  arrangement.  One  will 
be  a  moveable  (Isotonic)  controller  with  output  propor¬ 
tional  to  displacement#  and  the  other  will  be  a  rigid 
(isometric)  controller  with  output  proportional  to  force. 
The  rationale  for  considering  two  types  of  integrated  con¬ 
trol  configurations  is  to  gain  information  concerning  both 
force,  and  displacement  characteristics  to  arrive  at  the 
optimal  arrangement. 

Some  work  has  been  conducted  on  the  integrated  con¬ 
troller  concept.  For  instance#  Boeing-Vertol  has  studied 
a  variety  of  control  types  as  well  as  stability  and  aug¬ 
mentation  systems.  Sikorsky  has  studied  both  displacement 
and  force  stick  controllers  with  the  addition  of  a  secon¬ 
dary  cask.  The  object  of  the  current  research#  and  what 
has  not  been  done  to  date#  is  to  draw  some  conclusions 
about  the  use  of  conventional  controls  vs  an  integrated 
controller  using  objective  performance  measures#  rather 
than  subjective  report. 

It  Is  assumed  that  use  of  a  more  efficient  controller 
will  resume  in  improved  tracking  performance.  This 
assumption  will  be  tested  by  comparing  performance  between 
conventional  controls  and  the  integrated  controller  on  a 
3-axis  compensatory  tracking  task. 

The  specific  hypotheses  to  be  tested  arei  1) Tracking 
performance  will  be  better  with  the  integrated  controllers 
than  with  conventional  controls;  2}  Tracking  performance 
will  be  different  with  the  isometric  controller  than  with 
the  isotonic  integrated  controller. 
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Subjects.  Subjects  will  be  non-helicopter  piljts  to  elim- 
inate  effects  of  prior  training.  Subjecs  will  be 
screened  with  the  use  of  a  pre-  experimental  tracking  task 
to  assure  that  they  possess  psycho-motor  ability  typical 
of  that  found  in  the  pilot  population.  The  pre- 
experimental  tracking  task  will  be  Jex's  (1966)  ’'Critical 
Tracking  Task*  which. prpports  to  provide  a  low  variability 
indicator  of  the  operator's  tracking  ability.  A  matched 
group  design  will  be  employed  with  subjects  matched  on  Jex 
Tracking  Task  performance,  to  guarantee  some  equality 
among  groups.  Subjects  will  then  be  randomly  assigned 
into  one  of  three  experimental  conditions;  c_onventional 
control,  isotonic  integrated  control,  or  isometric 
integrated  control,  resulting  in  three  groups  of  six  sub¬ 
jects  each. 


Dasiqn.  A  3  X  3  mixed  design  will  be  employed  with  con- 
trol  configuration  (  conventional,  isotonic,  isometric)  as 
the  between  factor,  and  task  difficulty  (low,  medium, 
high)  as  the  repeated  measures  factor.  A  randomized  block 
design  will  be  used  with  blocking  on  the  Jex  tracking  task 
score . 


Apparatus.  The  pre-exper imental  (Jex)  tracking  task  will 
be  a  riven  by  an  EAZ  2000  computer,  and  displayed  on  a  CRT. 
Subject  input  will  be  via  a  joystick  mounted  in  a  table 
and  located  directly  in  front  of  the  scope. 

The  experimental  station  will  rosemble  a  helicopter 
cockpit.  The  station  will  consirt  of  a  platform  upon 
which  a  seat,  cyclic,  collective,  and  rudder  pedals  typi¬ 
cal  of  a  helicopter  will  be  mounted.  The  station  will 
also  be  suited  for  the  mounting  of  the  integrated  con¬ 
trollers  on  the  right  side  of  the  seat.  On  the  platform 
will  be  a  21-inch  display  oscilloscpe  centered  at  eye 
level  in  front  of  the  seat,  and  sloped  back  from  the  vert¬ 
ical  by  4  degrees.  A  white  noise  generator  and  three 
first  order  filters  will  generate  the  input.  The  experi¬ 
mental  task  displays,  recording  of  subject  responses  and 
analysis,  will  be  accomplished  by  a  DEC  11/34  computer. 


Procedure.  The  task  will  involve  manipulation  of  the 
roll,  pitch,  and  yaw  axes,  on  a  display  like  that  shown  in 
Figure  l.  The  object  of  the  task  will  be  to  maintain  the 
error  at  a  minimum  in  all  three  axes  using  the  appropriate 
controls  by  keeping  the  display  as  close  to  the  null  posi¬ 
tion  (Figure  la)  as  possible.  The  task  requires  the  human 
operator  to  close  three  loops  simultaneously  as 
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illustratad  in  Figure  2.  Subjects  will  by  tracking  a  k/s 
plant  in  all  axes. 

In  an  off-line,  non-linear  helicopter  simulation 
using  a  generic  pilot  model,  Phatak  (1980)  demonstrated 
that  system  performance  in  the  pitch  axis  will  be  severly 
degraded  if  the  model  remains  open  loop  for  seven  seconds. 
Similarly,  roll  and  yaw  performance  will  be  degraded  in 
fifteen  and  twenty  seconds  respectively.  This  translates 
into-a  different  amount  of  control  activity  required-  for 
the  three  axes.  This  relationship  of  control  activity 
will  be  maintained  in  terms  of  the  bandwidth  of  the  forc¬ 
ing  functions  of  the  three  axes.  Specifically,  the  input 
forcing  function  will  be  filtered  white  noise,  a  separate 
level  for  each  axis  in  accord  with  the  frequency  domain 
derived  from  Phatak* a  study.  Then,  three  levels  of  the 
forcing  function  bandwidth  will  produce  three  levels  of 
tracking  difficulty  while  maintaining  the  bandwidth  rela¬ 
tionship  among  the  axes.  Figure  3  illustrates  the 
bandwidth  relationship  among  the  axes  and  among  the  diffi¬ 
culty  levels. 

error  in  the  pitch  axis  will  be  displayed  along  the 
ordinate  (Figure  lb);  error  in  the  yaw  axis  will  be 
displayed  along  the  abscissa  (Figure  Ic) ;  and  error  in  the 
roll  axis  will  be  displayed  as  angular  deviation  about  the 
vertical  (Figure  Id) •  Subjects  will  receive  36  two-minute 
trials  per  day,  with  a  five-minute  break  after  each  set  of 
nine  trials.  Subjects  will  participate  until  their  indi¬ 
vidual  performance  reaches  an  asymptotic  level. 


Analysis.  Data  for  analysis  will  be  obtained  from  five 
sessions  during  which  the  asymptotic  level  has  been  main¬ 
tained.  Root  Mean  Squared  (RMS)  error  will  provide  the 
dependent  measure  (Poulton,  1974).  For  a  specific  trial, 
the  performance  measure  will  be  the  sum  of  the  mean  RMS 
error  scores  from  each  axis.  The  trial  error  scores  will 
then  be  averaged  for  each  session  (36  trials)  providing  an 
overall  session  performance  measure.  A  3  (control  confi¬ 
guration)  by  3  (difficulty  level)  analysis  of  variance 
will  be  performed  on  the  data. 


under  these  controlled  conditions,  with  a  statistically 
well-defined  task,  the  goal  of  the  present  research  effort 
is  to  lay  a  sound  foundation  for  further  study  and 
development  of  an  optimal  integrated  controller. 
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AppllcatlOD  of  Speech  Synthesis  Technology 

to 

Stinger  Missile  System 

i-  ;i' 

M.  J.  Crisp,  Tin  and  L.  R.  Perkin 

GENERAL  DYNAMICS,  POMONA  DIVISION 


SUMMARY 

'r^Technlques,  for  improved  performance  and  reduced  training  cost  of  the 
Uxp.  Army/General  Dynamics  Stinger  weapon  system  through  improved 
man-machli}^  Interface  and  reduced  operator  work  load,'4>eve-been  evaluated*: 
Two  areas,; have  been  Identified  for  possible  Improveisent  t'whlnb  dncludS. 
irc  proper  execution  of  operational  procedures  and  recognition  of  audio  cues. 
One  of  the  possible  solutions  proposed  is  to  use  speech  synthesis 
technology  to  provide  the  Stinger  operator  with  a  GO/NO  GO  type  of  voice 
cue.  The  voice  module  can  also  be  used  to  correct  operator  procedural 
errors  and/or  cue  the  operator  as  to  what  function  to  perform  next. 


A  prototype  unit  Is  currently  under  extensive  evaluation  by  thja—U.SA  - 
Army  users  at  Ft.  Bliss,  Texa«-.y  The  research  and  development  effort  at 
General  Dynamics,  Pomona  Div,lsionMs  continuing  with  emphasis  on 
mao-machine  interface  optimization  including  vocabulary  selection. 
Interface  logic  optimization,  performance  impact  evaluation,  power 
consumption  and  weight  reduction,  and  optimal  system  packaging. 
Fur  therm  j^he  potential  of  this  added  voice  capability  on  the 

man-portable  weapon  system  with  applications  to  command,  control,  and 
communications  (C^J^interactlon  will  be  fully  explored  in  the  future. 

1^ 

INTRODUCTION 


I  The  effectiveness  of  any  weapon  system  depends  not  only  on  the  weapon 

,  itself,  but  also  on  how  the  weapon  Is  used  by  Its  operator.  This  Is 

»  especial] y  true  for  a  man-portable  «ystem  like  the  U.S.  Army  Stinger 

C  surface-to-air  guided  missile.  This  shoulder  launched,  fire  and  forget 

weapon  is  a  very  effective  and  yet  simple  to  operate  system.  There  are 
^  only  a  few  operating  procedures  to  be  executed  properly  in  order  to  fire 

I  the  missile  round.  However,  humans  do  make  errors  which  can  cause  a  miss 

'  under  normal  field  testing  conditions,  not  to  mention  what  can  happen  in  a 

■  hostile  battlefield  environment. 

!  Training  helps  to  reduce  operator  error.  Therefore,  the  U.S.  Army 

has  provided  operators  with  several  levels  of  training  facilities  from  a 
I  portable  Stinger  trainer  to  a  sophisticated  half  dome  moving  target 
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sloulator.  Most  soldiers  who  complete  this  series  of  training  exercise 
have  demonstrated  an  operational  effectiveness  of  the  weapon  close  to  Its 
Inherent  effectiveness  as  a  result  of  the  training  method. 

But  even  the  most  extensive  training  cannot  entirely  eliminate  the 
human  related  errors.  Furthermore,  the  training  cost  Is  high  and  may  be 
expected  to  go  even  higher  in  the  future.  Therefore,  at  General  Dynamics, 
Pomona  Division,  a  Stinger  product  Improvement  program  has  been  underway 
to  find  ways  to  reduce  the  operator's  work  load  and  Improve  man-weapon 
interface.  The  ultimate  goal  is  to  minimize  possible  causes  of  human 
Induced  errors  and  also  reduce  the  training  cost. 

Two  areas  have  been  identified  for  possible  human  factors/man-machlne 
interface  Improvement.  These  are  audio  signal  cues  recognition  and 
operating  procedure  execution.  Among  four  different  audio  signals,  the 
seeker  acquisition  tone  discrimination  requires  skills  that  can  only  be 
acquired  through  tracking  live  targets.  The  high  cost  of  operating  live 
targets  limits  this  type  of  tracking  exercise  to  a  minimum.  Operating 
procedure  execution,  in  general,  does  not  constitute  a  major  problem,  but 
the  idea  of  automated  or  even  semi-automated  operation  of  a  man-portable 
weapon  system  is  desirable. 


B 


PROBLEM  IDENTIFICATION  AND  SOLUTION  PROPOSITION 


There  are  roughly  1i»  steps  in  the  launch  sequence.  Some  of  them  are 
trivial  like  "shoulder  weapon".  Some  of  them  are  self-correcting,  for 
example,  if  the  operator  does  not  follow  Step  4  to  remove  the  cover,  his 
view  would  be  blocked.  Overall,  Steps  1,  2,  3»  4,  5,  6,  10,  and  14  are 
straight  forward  and  in  general  contribute  minimally  to  gunner  errors. 
But  steps  7f  9*  11  and  13  require  skill,  and  hence  training.  Improper 
handling  of  any  one  or  more  of  these  procedures  can  cause  the  missile  to 
miss  the  target.  In  particular,  IFF  (Identification  of  Friend  or  Foe) 
reply  signals  use  three  different  audio  tones  to  cue  the  operator  with  the 
information  of  a  friend,  a  possible  friend  or  an  unknown  target.  The 
missile  seeker  acquisition  signal  also  has  to  be  recognized  quickly  by  the 
operator  to  uncage  the  seeker  head  for  continuing  missile  tracking.  The 
reaction  time  is  critical.  In  other  words,  the  operator  has  to  properly 
execute  the  procedure/sequence  and  firmly  recognize  the  audio  signal  under 
any  adverse  battle  field  conditions  In  a  very  short  time.  Furthermore, 
there  is  neither  additional  direct  cues  regarding  Improper  procedure 
execution  nor  verification  of  the  correctness  of  the  recognition  of  audio 
signals.  It  is  this  lack  of  communication  between  the  operator  and  his 
weapon  that  prompted  the  U.S.  AiTny  Missile  Command  and  General  Dynamics 
to  consider  the  addition  of  the  digital  voice  capability  to  the  Stinger 
missile  system. 


During  the  current  phase,  the  task  is  to  produce  a  field 
demonstration  unit  for  further  feasibility  study.  The  design  will 
strictly  follow  the  guidelines  of  the  product  improvement  program  (PIP). 

Fall  Operable 
Weight  Conscious 
Cost  Effective 


VOICE  CUES  SELECTION 


Voice  cue  selection  is  a  man-machine  interface  problem.  There  is,  in 
general,  no  theoretical  means  to  evaluate  the  effectiveness  of  the  voice 
cue  approach  against  the  current  audio  tone  method  or  one  form  of  voice 
cue  versus  another.  The  ultimate  Judgement  can  only  come  from  statistical 
results  of  field  tests  with  real  operators.  Nevertheless,  durir^g  the 
prototype  design  phase  we  have  carefully  studied  many  possible  approaches 
which  are  feasible  to  implement.  Four  types  of  voice  cues  were  singled 
out  and  described  below. 

(1)  Echo/Confirmation:  After  the  operator  has  performed  a  certain 
function,  the  voice  module  will  respond  with  what  has  been  done  so  that 
the  operator  will  know  whether  he  has  followed  the  correct  procedure. 
This  Is  a  leader  and  follower  type  of  interface  and  perhaps  the  easiest 
for  implementation.  A  major  drawback  with  this  approach  is  that  the 
expected  confirmation  generally  slows  the  gunner's  reaction  time. 

(2)  Error  Correction:  The  voice  module  only  responds  when  the  operator 
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makes  a  mistake  and  Is  otherwise  silent.  This  approach  has  the  advantage 
of  good  reaction  time.  The  voice  module  plus  the  control  microprocessor 
plays  a  watchdog  role. 

(3)  Comnand/Remind :  This  is  a  straight  forward  approach.  The  voice 
module  will  speak  out  what  should  be  done  next  and  will  repeat  the  same 
message  after  a  fixed  time  delay  until  the  operator  has  performed  the 
procedure.  This  is  again  roughly  a  leader  and  follower  type  of  interface, 
but  with  the  roles  reversed  from  option  (1). 

(4)  Warning:  In  case  of  anything  unusual,  the  voice  module  will  issue  a 
warning  to  the  operator.  For  example,  when  the  battery  voltage  is  low, 
the  operator  w.'.ll  be  warned  to  replace  the  battery. 


During  the  prototype  design  phase,  a  combination  of  all  the  above 
options  was  used  except  for  the  echo/confirmation  approach.  As  part  of 
the  field  test  evaluation,  more  study  will  be  done  in  the  future  so  that 
the  best  form  of  man-weapon  dialogue  will  be  Implemented. 


Figure  2  depicts  the  voice  cue  logic  sequence.  The  words  within  the 
double  quatation  marks  are  outputs  from  the  voice  modules. 


INSEST 

Battery 


Fig. 2  VOICE  COE  LOGIC  DIAGRAM 
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Basically,  what  has  been  done  is  to  augment  the  modulated  harmonic 
audio  tones  with  the  unambiguous  voice  in  plain  English  to  reduce  the 
possible  confusion  in  audio  tone  recognition.  Furthermore,  if  a 
significant  time  delay  occurs  the  voice  module  will  remind  the  operator 
what  is  to  be  done  next,  correct  him  in  case  of  procedural  error,  and 
finally  warn  him  about  anything  unusual. 


MAKING  OF  VOICE  HODOLE 


Figure  3  depicts  the  interface  between  the  voice  module  which 
consists  of  an  Intel  8035  microprocessor  and  a  General  Instrument  VSM2032 
speech  synthesis  IC  unit  and  various  Interacting  components  including  the 
missile  control  electronics  and  the  speaker. 


'i 
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Fig. 3  SYSTEM  IMPLEMENTATION 


Three  kinds  of  speech  synthesis  chips  or  techniques  are  commercially 
available.  These  are  Formant  Synthesis  (Phoneme/allophone) ,  Linear 
Predictive  Coding  (  LPC  }  and  Wave  Form  Digitization.  Speech  synthesis  IC 
units  based  on  the  first  two  methods  have  been  available  oommeroially  for 
several  years  by  quite  a  few  chip  manufacturers.  The  third  one  is  a 
fairly  new  technique.  Both  the  formant  synthesis  and  LPC  techniques  units 
were  considered ; however  we  fir^lly  chose  a  LPC  chip  because  of  its  high 
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Quality  hunan>llke  voice  compared  to  the  alight  meohanloal  sound  of 
formant  synthesis  chips.  The  need  for  large  data  storage  is  not  oritioal 
in  this  application  because  only  a  limited  number  of  vocabularies  is 
currently  required. 


The  whole  module  weights  only  8.0  ozs  and  draws  approximately  2.5 
watts  of  power.  The  voice  unit  uses  the  same  battery  used  by  the  missile 
launcher. 


DISCUSSION  AND  CONCLUSION 


The  first  demonstration  unit  was  completed  in  October  1981  and  was 
Initially  tested  by  General  Dynamics  engineers  and  training  instructors. 
The  results  were  good.  The  complete  feasibility  evaluation  is  presently 
underway  by  the  U.S.  Amy  operators. 

As  a  tactical  weapon.  Stinger  guided  missile  system's  performance  can 
best  be  described  by  its  lethality  and  reaction  time.  Lethality  is  more  a 
missile  design  problem  although  the  proper  execution  of  operating 
procedures  Is  required  to  achieve  the  designed  missile  performance  level. 
However,  reaction  time  is  as  much  a  human  factors  problem  as  a  design  one 
for  a  man-portable  system.  It  takes  Intelligence  and  experienc**  to 
recognize  the  seeker  lock  on  signal  for  a  target  masked  by  heavy 
background  noise.  The  difference  between  a  poorer  operator  and  a  better 
one  can  be  either  a  long  waiting  period  between  action,  missing  the  signal 
completely,  or  a  clean  shot.  Since  the  voice  cue  or  command  is  really  a 
GO/NO  GO  type  of  slgnul,  it  has  the  potential  to  eliminate  some 
uncertainty  for  some  operators,  and  thus  insures  that  all  operators  will 
be  able  to  react  within  an  acceptable  time  period.  By  retaining  the 
modulated  audio  tones  presently  being  used  on  Stinger,  the  fast  reacting 
or  more  experienced  gunners  should  not  be  adversely  affected. 


Through  the  addition  of  the  voice  module,  it  is  believed  that  the 
goal  of  reduced  operator's  work  load  and  minimal  chance  of  human  related 
error  has  been  achieved.  Because  of  these,  hopefully  the  Army  training 
costs  can  be  reduced  as  well. 


FUTURE  WORK 


The  physical  size,  weight  and  power  consumption  of  the  voice  module 
are  acceptable  for  this  phase.  However,  in  the  future,  the  Intel  8035 
microprocessor  will  llksly  be  replaced  by  a  CMOS  microprocessor  to  reduce 
the  power  consumption.  The  module  size  and  weight  will  also  be  reduced 
using  a  General  Instrument  SP0256  speech  synthesis  chin  and  SPR16  memory 
ROM  which  replaces  the  VSM2032  module.  All  electronic  'rcuitry  and  chips 
will  then  be  optimally  packaged  as  well. 


•  a  •  • 
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The  major  future  effort,  other  than  the  hardware  change,  will  be  the 
optlalcatloo  of  operator- weapon  interface  softwsu'e.  Vocabulary  selection 
for  easy  audlobility,  voice  with  different  tempo,  pitch  and  amplitude 
study  and  control  logic  optimization  are  all  subjects  for  future  work. 

Meantime,  the  research  and  development  effort  is  oontioulng  to 
further  explore  the  full  potential  of  the  voice  capability  to  the  Stinger 
weapon  systems  such  as  interaction. 
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FACTORS  AFFECTING  IN-TRAIL  FOLLOWING  USING  CDTI 
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James  R.  Kelly  and  David  H.  Williams 
Flight  Management  Branch 
Flight  Control  Systems  Division 
NASA  Langley  Research  Center 
Hampton,  VA  23665 


ABSTRACT 

5?— The  '^ef>9l€y  Research  Center  is  participating  ^  a  joint  NASA-FAA 
program /designetp to  explore  the  potential  benefits  ana  liabilities  of 
Cockpit  Display  of  Jraffic  Information  (CDTI)  for  a  broad  range  of 
applications.  As  a  part  of  this  effort,  piloted  simulations  have  been 
conducted  to  determine  the  effect  of  various  display  parameters  and 
separation  criteria  on  terminal  area  in-trail  following  using  CDTI.  Both 
a  conventional  air  carrier  configuration,  wherein  the  traffic  data  is 
presented  on  a  centrally  located  weather  radar  scope,  and  an  advanced 
configuration,  where  the  data  is  superimposed  on  the  primary  navigation 
display,  have  been  investigated.  The  scenarios  employed  have  ranged  from 
following  a  single  lead  aircraft  to  following  multiple  CDTI-equipped  air¬ 
craft  queues,  This  paper  summarizeiJhe  results  of  these  experiments 

and  discuss^heir  implications  on  the  design  and  use  of  CDTI  for  in-trail 
separation. 


INTRODUCTION 


Cockpit  Display  of  Traffic  Information  (CDTI)  can,  in  the  broadest 
sense,  include  devices  ranging  from  a  relatively  simple  panel  mounted 
alphanumeric  presentation  of  range  and  bearing  to  other  aircraft,  to 
pictorial  electronic  navigation  displays,  electronic  primary  flight 
displays  and/or  even  head-up  displays  which  incorporate  traffic  informa¬ 
tion.  While  any  of  these  devices  could  be  employed  for  self-spacing, 
this  paper  will  focus  on  cathoderray-tube  (CRT)  displays  presenting  a 
downward-looking  picture  (a  plan  view)  of  the  traffic  situation  such  as 
shown  in  figure  1.  In  addition,  only  the  in-trail,  self-spacing  task 
will  be  discussed,  although  it  is  widely  recognized  that  this  is  only 
one  of  many  potential  applications  for  COTI. 

This  paper  will  summarize  the  results  of  some  recent  experiments 
conducted  at  the  Langley  Research  Center  as  part  of  a  joint  NASA-FAA  CDTI 
program.  The  effect  of  various  factors,  such  as  display  size,  and  symbology 
will  be  discussed,  along  with  self-spacing  results  obtained  during  piloted 
simulations  using  a  variety  of  spacing  criteria. 


SYSTEM  CONSIDERATIONS 


System  Elements 

Conceptually,  a  CDTI  can  be  divided  Into  functional  elements  as  illus¬ 
trated  in  figure  2.  There  needs  to  be  a  sensor  for  detecting  traffic, 
algorithms  for  processing  the  traffic,  and  a  CRT  (in  this  case)  for 
displaying  it.  In  implementing  such  a  system,  however,  one  is  confronted 
with  a  multitude  of  choices  and  constraints  which  can  affect  the  utiliza¬ 
tion  of  the  CDTI.  The  following  sections  will  address  some  of  these  Issues 
and  discuss  the  pros  and  cons  of  various  choices  based  on  the  results  of  our 
research  to  date. 


Traffic  Sensor 

The  particular  sensor  used  to  obtain  traffic  information  for  CDTI  will 
have  a  considerable  influence  on  the  accuracy,  noise  and,  possibly,  the 
update  rate  of  the  displayed  traffic.  While  we  have  not  specifically 
addressed  all  of  these  areas,  we  have  examined  the  effect  of  noise  on  the 
displayed  information  for  the  in-trail  following  task. 

★ 

The  simulator  study  was  based  on  an  aircraft-oriented,  range-bearing 
device  (such  as  a  TCAS  II)  with  the  "noisy"  traffic  data  displayed  on  a 


it 

"Simulation  Study  of  Traffic-Sensor  Noise  .'f'.'ects  on  Utilization  of  Traffic 
Situation  Display  for  Self-Spacing  Task,"  by  David  H.  Williams  and  Gene  C. 
Moen,  Proposed  NASA  TP. 
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centrally  located  CRT.  The  magnitude  of  the  noise  was  parametrically  varied 
by  adjusting  the  standard  deviation  values  for  the  range  and  bearing  noise 
components.  The  results  are  shown  In  figure  3,and  indicate  the  pilot 
acceptability  boundary  for  range  and  bearing  noise.  This  limit  was  based 
on  the  pilot’s  tolerance  of  the  noise, as  opposed  to  the  spacing  performance 
he  could  achieve.  In  fact,  position  errors,  caused  by  sensor  noise,  with 
standard  deviation  values  up  to  0.3  n.  mi.  range  and  8  degrees  azimuth 
had  a  negligible  effect  on  performance. 


Traffic  Selection 

It  is  very  unlikely  that  all  of  the  traffic  within  a  given  area  would 
be  displayed  on  a  CDTI  simultaneously.  To  get  an  idea  of  what  the  CDTI 
might  look  like  if  it  did  portray  all  the  traffic,  consider  the  following: 

In  developing  the  TCAS  system,  the  FAA  is  using  a  traffic  density  of  0.4 
aircraft  per  square  nautical  mile  for  the  year  2000.  This  means  that  a 
CDTI  with  a  10-n.  mi.  radius  could  show  up  to  126  targets.  In  one  of  our 
early  CDTI  tests  (ref.  1),  display  clutter  was  a  major  problem,  even  though 
no  more  than  six  other  aircraft  ever  appeared  on  the  screen  at  one  time. 
Obviously,  some  of  the  traffic  must  be  filtered  out. 

There  are  various  filtering  schemes  that  can  be  employed.  Figure  4, 
which  was  generated  during  a  contract  study  examining  various  CDTI 
traffic  selection  criteriat  shows  the  effect  of  altitude  filtering  in  reducing 
the  number  of  aircraft  that  would  appear  on  a  CDTI  with  a  range  of  10  n.  mi. 

As  suggested  by  Lockheed?*  intermediate  altitudes  (±1250,  ±1750, 
etc.)  should  probably  be  employed  for  the  filtering  band  (it  may  be  asym¬ 
metrical)  to  keep  aircraft  at  "even"  altitudes,  such  as  4000,  4500,  and 
5000  feet,  from  Intermittently  tripping  the  threshold. 

Another  option  for  selecting  traffic  is  to  employ  so-called  TAU  filtering. 
The  time  constant  TAU  is  obtained  by  dividing  the  traffic’s  range  by  its 
range  rate  relative  to  ownship.  As  illustrated  in  figure  5,  the  TAU  criteria 
eliminates  most  of  the  traffic,  even  at  a  fairly  long  time  constant  of 
4  minutes. 

Although  any  target  selection  criteria  is  going  to  involve  compromise, 
it  seems  that  limiting  the  number  of  aircraft  displayed  will  not  be  too 
difficult.  There  is  a  question  of  how  to  treat  a  "pop-up"  target,  however. 

This  is  an  aircraft  which  is  within  the  horizontal  range  covered  by  the 
display,  but  had  been  filtered  out  using  some  criteria  such  as  altitude.  Once 
the  target  oOmes  within  the  selection  criteria,  some  appropriate  method  of 
bringing  it  up  on  the  display  must  be  employed. 


*Work  done  under  contract  to  NASA  by  the  Systems  and  Measurements  Division  of 
Research  Triangle  Institute. 

irit 

From  work  done  under  contract  to  NASA  by  Lockheed-Cal ifornia  Company. 
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DISPLAY  CONSIDERATIONS 


Location 

Our  simulator  studies  to  date  have  employed  both  conventional  and 
advanced  cockpit  configurations,  as  shown  in  figures  6,  and  7,  respectively. 
In  the  conventional  cockpit  configuration,  the  traffic  information  is 
presented  on  a  single  CRT  located  in  the  center  console  where  a  weather 
radar  is  frequently  located.  In  the  advanced  configuration,  the  traffic 
information  is  presented  on  the  navigation  displays  located  on  the  captain 
and  first  officer's  primary  display  panels. 

Although  we  have  not  conducted  any  studies  aimed  directly  at  location 
effects,  there  is  evidence  from  several  studies  which  indicate  that  when 
the  surrounding  traffic  is  updated  discretely  (typically  every  4  seconds), 
the  pilots  wait  for  an  update  while  scanning  the  CDTI.  During  the  study 
reported  in  reference  2,  for  example,  where  the  CDTI  was  centrally  located, 
one  of  the  test  subjects  commented  that  the  physical  location  of  the 
display  caused  him  to  "spend  too  much  time  away  from  his  primary  flight 
displays."  (This  update  rate/location  problem  had  not  been  noted  by  the 
same  pilot  when  he  flew  the  advanced  cockpit  configuration.)  One  possible 
solution  for  this  problem  is  to  predict  the  traffic's  position  between 
sensor  updates,  and  update  the  CDTI  continuously  using  estimated  positions. 

Hand-in-hand  with  location  is  whether  there  are  one  or  two  CDTI's  in 
the  cockpit.  Generally,  if  it's  centrally  located,  there  will  only  be 
one;  if  the  CDTI  is  integrated  into  the  primary  flight  displays,  there 
may  be  two  of  them.  In  all  of  our  in-trail  following  studies,  we  have 
found  that  most  pilots  prefer  to  use  the  most  sensitive  map  scale  feasible. 
With  two  CDTI's,  as  in  the  advanced  cockpit  configuration,  one  pilot  can 
use  the  sensitive  scale  for  self-specing,  while  the  other  pilot  uses  a 
less  sensitive  scale  for  monitoring  th?  traffic  situation.  With  a  single 
centrally  located  CDTI,  either  a  compronise  map  scale  setting  or  a 
time-sharing  scheme  has  to  be  utilized. 


Display  Size 

One  of  the  simulation  studies  at  Langley  was  directfd  specifically 
at  determining  the  effect  of  display  size  on  the  self-spacing  task  (ref.  2). 
This  study  was  conducted  in  the  conventional  aircraft  simulator  (fig.  6), 
using  the  CDTI  format  shown  in  figure  8.  The  important  feature  of  this 
display,  with  respect  to  self  spacing,  is  that  pilot  selectable  data  blocks 
were  available  which  contained  traffic  groundspeed.  This  allowed  the 
pilot  to  set  up  a  comfortable  overtake  velocity  on  the  lead  aircraft  for 
rendezvous,  and  then  maintain  the  prescribed  spacing  interval  by  matching 
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the  lead  aircraft's  ground«peed.  This  technique  tended  to  diminish  the 
importance  of  using  a  sensitive  map  scale  for  accurately  determining 
ownship's  position  relative  to  the  target.  Although  the  standard  devia¬ 
tion  of  the  spacing  performance  shows  a  consistent  trend  toward  lower 
values  (improved  performance)  with  larger  displays,  the  mean  spacing 
performance  shows  only  a  small  (±0.06  n.  mi.)  random  variation.  Display 
size,  therefore,  may  not  he  too  critical  if  appropriate  information  is 
contained  in  the  traffic  data  blocks. 


Display  Symbology 

The  general  display  format  shown  in  figure  8  has  been  employed  in 
all  of  our  in-trail  following  studies  to  date.  The  main  features  include 
ownship  oriented  map  information,  coded  traffic  information,  traffic 
trend  vectors,  traffic  history  trails,  and  traffic  data  blocks.  The  major 
variation  in  the  symbology  between  studies  has  been  the  type  of  spacing 
cue  employed.  The  straight  trend  vector  emanating  from  ownship  in 
figure  8  illustrates  the  constant  distance  (CD)  spacing  cue  used  in 
reference  2.  Two  range  arcs  cross  the  trend  vector  at  3  and  5  n.  mi,, 
which  were  the  spacing  requirements  employed  in  the  study. 

* 

The  next  figure  (9)  shows  the  symbology  used  in  an  investigation 
of  time-based  self-spacing  technioues.  In  this  study,  two  different 
spacing  cues  were  employed;  part  (a)  shows  a  constant  time  delay  (CTD) 
configuration  where  the  lead  aircraft  leaves  an  80-second  history  trail 
composed  of  20,  4-second  past  position  dots.  The  purpose  of  the  long 
history  trail  was  to  provide  a  path  for  own  aircraft  to  follow  when  the 
lead  was  not  flying  a  defined  navigation  route.  The  last  position  dot 
includes  a  line  and  a  data  tag  to  indicate  where  the  lead  aircraft  was 
80  seconds  ago  (the  spacing  criteria  employed),  and  what  its  groundspeed 
and  altitude  were.  Ownship  has  a  constant  time  predictor  trend  vector  in 
this  case,  which  indicates  where  ownship  will  be  in  80  seconds  if  the  pilot 
maintains  his  present  groundspeed. 

This  constant  time  predictor  (CTP)  is  actually  another  type  of  spacing 
cue,  as  illustrated  in  figure  9(b).  Here  the  line  and  data  block  have 
been  deleted  from  the  lead  aircraft's  trail  and  an  arc  has  been  added  to 
ownship's  time  predictor  to  emphasize  the  80-second  prediction  point. 

It  should  be  noted  that  these  last  two  formats  used  a  curved  trend 
vector,  which  predicted  ownship's  position,  even  during  turns. 


"Preliminary  Evaluation  of  Time-Based  Self-Spacing  Techniques  During 
Approach  to  Landing  in  a  Terminal  Area  Vectoring  Environment  Utilizing 
a  Cockpit  Traffic  Display,"  by  David  H.  Williams,  Proposed  NASA  TM. 


The  three  types  of  spacing  cues  illustrated  have  also  been  employed  in 
the  advanced  cockpit  simulator.  Figure  10  illustrates  one  advanced  cockpit 
format  which  combines  two  criteria,  the  CTP  and  CD.  The  traffic  in  this 
case  is  not  coded  (since  it  was  assumed  that  the  selection  criteria  would 
eliminate  all  incidental  aircraft)  and  only  has  a  groundspeed  tag.  Ownships 
trend  vector  is  composed  of  30,  60,  and  90  second  time  predicting  segments, 
and  a  range  tick  which  remains  3  n.  mi.  ahead  of  ownship  centereu  on  tlie 
trend  vector. 

The  type  of  symbology  used  to  represent  the  lead  aircraft  has  been 
found  to  be  of  little  importance  for  the  in-trail  following  task.  The 
primary  use  of  the  traffic  symbol  in  this  case  is  to  provide  a  position 
reference  for  the  spacing  cue.  For  other  uses  of  CDTI,  however,  the  traffic 
symbology  utilized  can  be  an  important  consideration.  In  particular,  for 
general  situational  awareness  and  COTI-aided  visua'  acquisition  of  traffic, 
coded  traffic  symbology  has  been  found  to  be  a  significant  factor. 

The  first  study  (ref.  1)  conducted  at  Langley  under  the  joint  NASA/FAA 
CDTI  program  was  a  flight  evaluation  of  the  coded  symbology  proposed  in 
references.  These  tests  were  directed  primarily  toward  situational  awareness, 
and  were  conducted  in  the  aft  flight  deck  (fig.  7)  of  the  TCV  aircraft  using 
the  CDTI  format  shown  in  figure  11.  The  traffic  was  displayed  both  with  and 
without  coded  symbology  which  distinguish  the  traffic's  altitude  relative  to 
ownship,  whether  they  were  under  ATC  control,  and  whether  or  not  they  were 
CDTI  equipped.  The  traffic  symbols  also  included  trend  vectors,  past  position 
trails,  and  pilot  selectable  data  blocks  giving  aircraft  identification, 
altitude,  and  groundspeed. 

The  most  advantageous  coding  of  the  symbology  in  this  study  was  found 
to  be  the  altitude.  With  coding,  the  pilot  could  eliminate  the  data  blocks 
until  he  needed  additional  information  on  a  proximate  aircraft.  Without 
altitude  coding,  the  pilot  had  to  call  up  the  data  blocks  more  frequently, 
aggravating  a  display  clutter  problem.  It  should  be  noted  that  for  in-trail 
following  tasks,  the  groundspeed  information  contained  in  the  data  tag  has 
been  found  to  be  an  important  piece  of  information.  It  would,  therefore, 
appear  advantageous  to  separate  groundspeed  and  altitude  data  tags  rather 
than  including  them  in  the  same  data  block. 

Another  indication  of  advantageous  coding  of  traffic  symbols  was  an 
observation  made  during  a  flight  test  involving  CDTI*  •  The  purpose 
of  this  study  was  to  evaluate  CDTI  as  an  aid  for  visually  locating  traffic. 

The  display  format  was  a  simple  plan  position  presentation  with  range  rings 
and  single  numbers  to  represent  the  traffic.  The  numbers  were  obtained  by 
sunning  the  last  four  bits  of  the  transponder  identification  code  of  each 
aircraft,  thus  providing  different  numbers  for  different  aircraft.  This 
simple  encoding  of  aircraft  Identification  in  the  traffic  symbols  was  found 
to  be  very  beneficial.  The  pilots  found  they  could  easily  track  a 
particular  aircraft  with  short  glances  at  the  display  even  in  the  high 
density  Los  Angeles  basin  with  as  many  as  12  aircraft  displayed  at  one  time. 
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Under  contract  to  NASA  by  Lockheed-California  Company. 


An  Important  point  to  be  made  about  display  symbology,  and  display 
considerations  in  general,  is  that  the  type  and  amount  of  information 
presented  on  the  display  is  highly  dependent  on  the  task  being  performed 
using  the  COTI.  In-trail  following  tasks  require  spacing  information  not 
necessary  for  other  CDTI  applications.  Similarly,  the  other  applications 
may  require  information  not  necessary  or  appropriate  for  in-trail  following. 

An  optimal  CDTI  display  must,  therefore,  be  flexible  enough  to  present  the 
minimum  necessary  information  in  the  form  appropriate  for  a  given  application. 


SPACING  CRITERIA 


Basic  Types 

Figure  12  illustrates  the  three  basic  spacing  criteria  employed  in  our 
studies;  namely,  the  constant  distance  criteria  (CD),  the  constant  time 
predictor  criteria  (CTP),  and  the  constant  time  delay  (CTD)  criteria.  The 
figure  also  gives  the  equations  for  the  spacing  intervals  in  terms  of  own- 
ship's  groundspeed,  Vq,  and  the  lead  aircraft's  groundspeed,  Vi  ,  and  time  predic¬ 
tor  and  time  delay  time  constants,  tp  and  T<j.  In  practice,  the  pilot  satisfies 
these  criteria  by  keeping  the  appropriate  cue  superimposed  on  the  lead  aircraft 
symbol  (CO  and  CTP),  or  on  his  own  aircraft  symbol  (CTD). 


Advantages--Disadvantages 

The  advantages  and  disadvantages  of  these  spacing  criteria  are  not 
always  immediately  apparent.  Consider  two  aircraft  flying  a  descending, 
decelerating  approach  to  a  landing,  using  the  constant  distance  criteria 
the  follower  must  match  the  lead  aircraft's  speed  profile  all  the  way  down 
the  approach.  This  is  illustrated  in  figure  13,  which  shows  the  lead  air¬ 
craft's  groundspeed,  and  the  groundspeed  which  must  be  flown  by  the  follower, 
as  0  function  of  distance  to  the  threshold  for  a  3-n.  mi.  separation 
requirement.  (The  ideal  groundspeed  for  several  different  spacing  criteria 
is  presented  in  reference  4  as  a  function  of  the  lead  aircraft's  groundspeed.) 
It  is  imnediately  apparent  that  this  criteria  forces  the  follower  to  slow 
up  too  far  out.  In  addition,  since  gear  and  flap  schedules  are  generally 
tied  to  specific  speeds,  this  means  that  if  the  lead  aircraft  extended  gear 
and  flaps  at  an  optimum  point,  then  the  follower  would  have  to  extend  them 
too  early  (although  at  the  correct  speed)  on  the  approach. 

Application  of  the  constant  time  predictor  criteria  yields  a  gradual 
reduction  in  spacing  as  the  aircraft  slow  up  coming  down  the  approach. 

This  reduction  in  spacing  represents  what  is  typically  done  in  today's  ATC 
system  and,  hence,  this  criteria  has  the  advantage  of  being  somewhat 
familiar  to  p^ots  and  controllers.  Another  advantage  of  the  CTP  criteria  is 


that  It  tends  to  smooth  out  speed  variations  of  tie  lead  aircraft.  This 
feature  Is  Illustrated  In  figure  14,  which  shows  a  follower  using  CTP 
spacing  on  the  same  lead  aircraft  as  used  in  the  previous  figure. 

One  of  the  disadvantages  of  the  CTP  criteria,  somewhat  apparent  on 
this  figure,  becomes  obvious  when  a  string  of  aircraft  are  following  each 
other  using  the  CTP.  The  problem  Is  that  the  CTP  criteria  causes  the 
follower  to  fly  slower  than  the  lead  aircraft  during  the  deceleration 
phase  of  the  approach  and  then  faster  than  the  lead  when  the  lead  Is  no 
longer  decelerating.  In  order  to  maintain  the  desired  time  Interval  spacing, 
the  follower  Is  thus  required  to  fly  a  faster  final  approach  speed  than 
the  lead  aircraft.  For  a  string  of  aircraft  using  CTP  spacing,  each  successive 
aircraft  would  thus  be  required  to  fly  progressively  faster  approach  speeds 
than  the  aircraft  preceding  It.  This  situation  is  operationally  unacceptable, 
since  each  aircraft  must  slow  to  specified  final  approach  speeds  as  dictated 
by  the  landing  procedures  for  the  aircraft.  This  operational  constraint 
results  In  a  slow-down  effect  where  each  aircraft  takes  longer  to  fly  the 
approach  than  the  preceding  aircraft. 

The  constant  time  delay  criteria  also  yields  a  gradual  reduction  in 
spacing  as  the  aircraft  decelerate  down  the  approach.  The  main  advantage  to 
CTO  Is  that  It  allows  the  follower  to  fly  the  same  speed  profile  as  the  lead 
aircraft  (fig.  15),  thus  avoiding  the  slow-down  effect  present  with  CTP 
spacing.  Of  course,  CTO  spacing  would  only  be  appropriate  for  similar  types 
of  aircraft.  A  possible  disadvantage  to  CTD,  as  Implemented  In  our  studies, 
is  the  narrowing  of  pilot  attention  to  the  area  of  the  display  directly 
surrounding  the  ownship  symbol.  As  a  consequence,  the  pilot  will  possibly 
lose  some  of  the  predictive  Information  concerning  path  changes  of  the  lead 
aircraft,  which  may  result  In  some  undesirable  lateral  errors  during  turning 
maneuvers.  This  situation  could  be  Improved  by  projecting  the  spacing  cue 
for  CTD  further  up  on  the  display  allowing  the  pilot  to  better  monitor  the 
ground  track  of  the  lead  aircraft. 


OPERATIONAL  FACTORS 


Pilot  Technique 

In  most  of  our  investigations  to  date,  we  have  observed  that  the  pilots 
appear  to  adopt  their  own  strategy  in  satisfying  the  spacing  criteria.  Some 
pilots  like  to  close  up  (rendezvous)  on  a  lead  aircraft  much  slower  than 
others.  Some  pilots  attempt  to  hold  position  accurately,  while  others  accept 
much  more  variation  in  their  relative  position.  In  addition,  the  pilots 
also  tend  to  hold  various  position  biases.  However,  In  most  cases  they  hold 
a  positive  position  bias;  that  is,  they  almost  always  maintain  more  separation 
than  that  specified. 
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While  our  studies  have  indicated  that  different  pilots  adopt  different 
techniques,  the  studies  have  also  shown  that  the  pilots  are  very  consistent 
when  It  comes  to  applying  their  own  particular  technique.  Figure  16  provides 
a  graphic  Illustration  of  this  point.  The  figure  shows  the  mean  Interarrival 
times  over  the  outer  marker  achieved  by  four  different  pilots  during  a  recent 
study.*  The  study  was  conducted  in  the  advanced  cockpit  simulator  and 
Involved  In-trail,  self-spacing  on  a  lead  aircraft  performing  a  profile 
descent  to  an  ILS  approach  and  landing.  The  test  matrix  was  based  on  a  full- 
factorial,  analysis  of  variance  design  and,  thus,  it  was  possible  to  obtain 
the  effect  means  for  each  test  subject.  The  two  sets  of  data  points  represent 
the  effect  means  from  two  test  series  separated  by  4  months. 

Both  of  the  data  sets  In  figure  15  illustrate  the  variation  between 
pilots  In  arriving  at  the  outer  marker.  By  comparing  the  two  curves,  however, 
one  can  see  that  the  pilot's  performance  was  relatively  consistent  between 
the  two  test  series  which,  as  noted,  were  4  months  apart.  Another  noticeable 
feature  of  the  data  Is  that  all  the  pilots  maintained  a  greater  separation 
during  the  second  test  series  than  they  did  during  the  first  one.  This  could 
be  a  learning  curve  effect,  since  the  pilots  tended  to  get  too  close  to  the 
lead  aircraft  during  the  first  simulation  series. 


Groundspeed 

Self-spacing  results  Indicate  that  the  groundspeed  of  the  lead  aircraft 
Is  an  Important  piece  of  Information.  When  spacing  is  via  the  constant 
distance  criteria,  the  pilots  can  match  their  own  groundspeed  to  the  lead 
aircraft's  groundspeed  on  a  knot-for-knot  basis.  The  same  matching  can  be 
applied  with  the  constant  time  delay  criteria  If  the  lead  aircraft's  previous 
groundspeed  is  shown.  Even  In  the  case  of  the  constant  time  predictor 
criteria,  where  the  pilots  cannot  match  the  lead  aircraft's  speed,  the  ground 
speed  tag  aids  the  pilot  In  determining  when  the  lead  aircraft  is  decelerating 
and  how  fast. 

Given  that  a  CDTI  will  display  the  groundspeed  of  the  lead  aircraft  (and 
possibly  other  aircraft  as  well),  then  the  question  arises  as  to  how 
accurately  this  Information  needs  to  be  displayed.  The  groundspeed  study 
referred  to  earlier  was  directed  specifically  at  answering  this  question.  In 
addition,  the  study  of  time-based  self-spacing  techniques,  conducted  In  the 
conventional  cockpit  simulator,  and  mentioned  previously  in  the  display 


★ 

"The  Effect  of  Lead  Aircraft  Groundspeed  Resolution  on  Self-Spacing 
Performance  Using  a  CDTI,"  by  James  R.  Kelly,  proposed  NASA  TP. 
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symbology  section,  can  also  shed  some  light  on  this  area,  since  the  tests 
included  approaches  with  and  without  groundspeed  information. 

Figure  17  presents  the  effect  means  for  the  lATS  at  the  threshold  as 
a  function  of  groundspeed  resolution.  This  data  comes  from  the  same  set 
used  to  illustrate  pilot  technique  in  the  previous  section.  Again,  two 
sets  of  data  are  shown,  one  from  each  of  the  two  test  series  conducted. 

It  is  immediately  obvious  that  the  separation  between  the  aircraft 
tends  to  be  less  (lower  lATS)  at  coarse  resolution  levels  compared  with 
fine  ones.  It  is  also  apparent  that  during  the  first  test  series  the  mean 
lATS  at  the  threshold  for  the  10-  and  20-knot  resolution  cases  were  less 
than  the  desired  separation.  During  the  second  test  series,  however,  the 
pilots  employed  a  spacing  buffer  such  that  even  though  they  tended  to  be 
closer  to  the  lead  aircraft  at  coarse  resolutions,  they  typically  crossed 
the  threshold  at  or  above  the  specified  separation. 

Based  on  our  observations  to  date,  it  appears  that  coarse  groundspeed 
readouts,  or  no  readout  whatsoever,  mask  the  lead  aircraft’s  decelerations, 
causing  the  pilots  to  inadvertently  lose  separation.  Once  separation  is 
"lost"  it  is  very  difficult  to  increase  It,  especially  when  the  lead  air¬ 
craft  is  continuously  decelerating,  or  when  ownship  has  reached  final 
approach  speed.  With  fine  resolutions,  on  the  other  hand,  the  pilots  can 
readily  detect  when  the  lead  aircraft  starts  to  decelerate  and  take 
appropriate  action  to  maintain  separation. 

The  results  from  the  conventional  cockpit  simulator  further  reinforce 
the  influence  of  target  groundspeed  knowledge  on  the  pilot's  spacing 
performance.  The  mean  lAT  at  the  runway  threshold  was  found  to  be  signi¬ 
ficantly  less  (3>s  sec)  without  a  groundspeed  tag,  compared  with  a  lead  air¬ 
craft  with  a  10-knot  resolution  tag.  In  addition,  the  spacing  strategy  of 
the  pilots  using  CD  spacing  criteria  was  significantly  affected  by  the 
presence  of  the  target  groundspeed  tag.  Without  the  groundspeed  information, 
the  pilots  would  hold  back  and  maintain  greater  spacing  as  they  turned  onto 
final  approach.  Despite  this  added  spacing  buffer,  the  pilots  would  still 
overshoot  the  desired  spacing  when  the  target  decelerated,  and  the  spacing 
when  the  target  crossed  runway  threshold  would  be  too  close.  Once  again,  , 
a  given  pilot  exhibited  highly  repeatable  performance,  with  significant 
differences  noted  between  pilots. 


Lead  Aircraft  Characteristics 

One  of  the  primary  factors  which  influences  the  pilot's  self-spacing 
performance  has  been  found  to  be  the  behavior  of  the  lead  aircraft  (it's  not 
unlike  formation  flying  where  a  smooth  leader  makes  the  wingman's  job  easier). 
At  one  end  of  the  spectrum  is  the  case  where  the  lead  aircraft  is  flying  at 
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constant  speed  and  constant  altitude.  Under  these  conditions  the  pilots  can 
achieve  very  consistent  spacing  with  standard  deviations  of  less  than  0.1  n.  ini. 
(refs.  5  and  6),  which  equate  to  an  interarrival  time  standard  deviation  of 
less  than  3  seconds. 

As  the  lead  aircraft  begins  to  maneuver  (decelerate),  even  mildly,  the 
self-spacing  performance  as  reflected  by  the  standard  deviations  is  adversely 
affected.  For  example,  reference  2  presents  spacing  data  for  two  constant 
distance  spacing  segments  during  which  the  lead  aircraft  is  performing  a 
very  docile  approach.  The  standard  deviations  ranged  between  0.13  and  0.28  n.  mi., 
depending  on  the  display  size  employed.  These  deviations  are  equivalent  to 
interarrival  times  between  about  3  to  7  seconds.  Another  study  using  a  similar 
task  also  produced  standard  deviations  in  the  same  3  to  7  second  range. 

The  most  recent  studies  conducted  at  Langley  have  involved  relatively 
active  lead  aircraft.  In  the  study  of  time-based  self-spacing  techniques, 
the  simulated  lead  aircraft  was  being  vectored  by  ATC  onto  the  final  approach. 

In  the  groundspeed  resolution  study,  the  lead  aircraft  was  performing  an  idle 
thrust  profile  descent  with  a  close  in  turn  to  final.  In  both  of  these  studies 
the  standard  deviation  of  the  interarrival  times  was  found  to  be  7  to  8  seconds. 
Figure  18  summarizes  our  experience  to  date  in  terms  of  the  lead  aircraft's 
effects  on  self  spacing  performance.  Keep  in  mind  that  these  are  only  "ball  park" 
numbers;  the  test  results  from  which  they  are  derived  have  invariably  involved 
lead-followers  of  the  same  type  aircraft.  This  probably  leads  to  better 
spacing  performance  than  could  be  obtained  with  pairs  of  different  typos,  which 
is  to  say  different  performance  characteristics.  On  the  other  hand,  the  data 
used  in  deriving  the  "ball  park"  numbers  have  not  been  massaged  to  eliminate 
particularly  poor  performance  producing  constraints  such  as  not  having  target 
groundspeed  information.  As  such,  the  data  base  is  not  necessarily  biased, 
since  there  are  offsetting  features  incorporated  in  it. 


Potential  Payoff 

Assuming  it  is  possible  to  achieve  a  standard  deviation  of  8  seconds  for 
interarrival  time  at  the  threshold  using  CDTI  in  the  real  world,  then  we  can 
estimate  the  potential  payoff  with  the  aid  of  figure  19. 

This  figure  illustrates  the  probability  density  curves  for  interarrival 
times  using  two  different  spacing  techniques.  The  standard  deviation  value 
of  18  seconds  used  for  the  curve  labeled  "ground  controlled"  was  taken  from 
reference  7  and  represents  the  accuracy  of  today's  ATC  system.  The  mean  for 
the  curve  in  figure  19  has  been  established  by  applying  a  ground  rule  that 
only  5  percent  of  the  arrivals  can  have  an  lAT  less  than  50  seconds.  (This 
actually  results  in  a  mean  of  about  79.6  seconds.)  The  basis  for  selecting 
a  specific  lAT  and  buffer  size  are  explained  in  reference  7.  In  this  paper, 
the  somewhat  arbitrary  choice  of  50  seconds  and  5  percent  will  serve  as  an 
anchor  point  for  comparing  CDTI  to  present  day  techniques. 
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If  we  apply  the  50'Second,  5-percent  ground  rule  to  our  "worst-case"  CDTI 
spacing  results  (la  »  8  seconds),  the  resulting  mean  Is  found  to  be  about 
63  seconds.  This  means  that  arriving  aircraft  could  be  spaced  17  seconds 
closer  together  which.  In  turn,  could  up  runway  throughput  10  to  25  percent 
or  more,  depending  on  the  mean  lAT  In  effect. 

In  addition,  CDTI  has  occasionally  been  referred  to  In  terms  of  being 
a  "tail-cutter"  of  the  lAT  distributions.  What  this  means  Is  that,  whereas 
a  buffer  Is  Incorporated  In  the  present  ground  controlled  system  to  allow 
for  the  occasional  3  or  4a  lAT  case,  CDTI  may  eliminate  such  cases  entirely 
and  thus  reduce  the  requirements  for  a  buffer.  It  has  certainly  been  our 
experience  that  the  pilots  are  continuously  aware  of  their  separation  from 
the  lead  aircraft  and  could,  1f  directed,  take  some  posifive  action  (such 
as  a  go-around)  to  eliminate  an  excessive  lAT  error.  In  any  event,  the 
pilot  using  CDTI  for  In-trail  following  is  always  aware  of  his  spacing  and 
would  probably  anticipate  an  intervention  by  an  ATC  controller  If  the 
situation  became  critical.  This  anticipation  feature  could  possibly  lead 
to  a  reduction  In  the  buffer  size  also. 


Multiple  Aircraft  Queues 

One  final  aspect  of  the  In-trail  following  task  this  paper  will  address 
deals  with  multiple  aircraft  queues  (sometimes  referred  to  as  a  "daisy-chain"). 
There  has  been  some  concern  that  a  queue  of  CDTI-equIpped  aircraft,  all  of 
which  are  self-spacing  on  their  respective  lead  aircraft,  would  lead  to 
dynamic  oscillations  similar  to  the  accordlan  effect  seen  with  a  queue  of 
automobiles  In  stop-and-go  traffic.  In  order  to  examine  this  potential 
problem,  we  utilized  the  COTI-equIpped  advanced  cockpit  simulator,  and  built 
a  queue  of  aircraft  by  recording  successive  self-spacing  approaches  and 
appending  them  to  a  common  traffic  tape.  The  first  approach  flown  was  a 
profile  descent  to  landing  without  any  traffic.  The  second  approach  Included 
self-spacing  on  the  lead  aircraft  while  flying  the  profile  descent.  For 
each  successive  approach,  ownship  was  added  to  the  end  of  the  queue  and  self¬ 
spaced  on  the  preceding  aircraft.  Two  aircraft  crews  were  utilized  for  these 
tests  In  which  the  pilots  alternated  captain  and  first  officer  duties,  and 
the  crews  flew  alternate  runs.  As  such,  the  pilots  had  no  a-priorl  knowledge 
of  the  lead  aircraft  they  would  be  following. 

Using  the  procedure  described  above,  queues  of  up  to  nine  aircraft  were 
built  during  the  simulation  sessions.  Figure  20  Is  a  photograph  showing  a 
case  where  ownship  Is  the  ninth  aircraft  In  the  string.  The  photo  was  taken 
during  a  session  using  a  60-second  constant  time  predictor  spacing  criteria. 
Other  sessions  were  conducted  using  a  60-second  constant  time  delay  criteria. 
The  results  of  these  tests  are  shown  In  figure  2  In  the  form  of  aircraft 
groundspeed  as  a  function  of  distance  to  the  threshold:  Only  the  odd  numbered 
aircraft  are  shown  to  avoid  clutter. 
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As  seen  from  the  figure,  there  is  no  evidence  of  any  oscillatory 
tendencies  with  either  spacing  criteria.  However,  the  slow  down  effect 
associated  with  the  CTP  criteria  and  discussed  in  a  previous  section,  is 
readily  apparent.  Whereas  the  first  aircraft  took  about  12  minutes  to  fly 
the  approach,  the  ninth  aircraft,  starting  from  the  same  initial  condition, 
took  about  1%  minutes  to  fly  the  same  approach.  In  the  case  of  the  CTD 
criteria,  on  the  other  hand,  there  is  no  slow  down  effect  and,  thus,  all 
the  aircraft  fly  the  approach  in  about  the  same  amount  of  time. 


CONCLUDING  REMARKS 


This  paper  has  attempted  to  explore  some  of  the  factors  associated  with 
in-trail  following  using  CDTI.  We  indicated  that  one  of  the  primary  factors 
affecting  self-spacing  performance  is  the  behavior  of  the  lead  aircraft.  Due 
to  this  finding,  there  is  an  obvious  need  for  data  dealing  with  self-spacing 
between  dissimilar  aircraft  types. 

Knowledge  of  the  lead  aircraft's  groundspeed  has  been  found  to  be  a 
significant  factor  in  self-spacing  performance  also.  Without  this  informa¬ 
tion,  the  pilot  has  a  tendency  to  overshoot  the  desired  spacing  and  get 
too  close  to  the  lead  aircraft.  Providing  groundspeed  information  leads  to 
more  accurate  spacing,  and  tends  to  compensate  for  a  less  than  desired 
display  sensitivity  in  the  case  of  small  displays. 

Test  subjects  used  in  our  simulation  studies  were  found  to  develop 
individual  techniques  for  performing  in-trail  following  tasks  with  a  CDTI. 

In  some  cases,  these  techniques  were  significantly  different  between  pilots; 
however,  the  individual  pilots  exhibited  consistency  in  applying  their  own 
techniques. 

Small  levels  of  traffic  sensor  noise,  as  exhibited  by  noise  in  the 
displayed  traffic  positions,  were  found  to  be  more  of  a  pilot  acceptance 
problem  than  a  spacing  performance  problem.  Pilots  objected  to  noise  levels 
greater  than  approximately  2°  azimuth  and  0.1  nautical  mile  range;  however, 
their  spacing  performance  was  unaffected  with  noise  levels  of  8°  azimuth 
and  0.3  nautical  mile  range. 

We  have  also  shown  that  self-spacing  within  CDTI-equipped  aircraft  queues 
do  not  appear  to  be  oscillatory,  as  had  been  previously  hypothesized.  Here 
again,  though,  these  results  are  based  on  limited  data  with  similar  aircraft 
types  following  one  another. 

In  sunmary,  we  have  learned  a  great  deal  about  CDTI,  in  general,  and 
about  in-trail  following,  in  particular.  In  spite  of  this,  however, 
numerous  questions  still  need  to  be  answered. 
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COCKPIT  DISPLAT  OF  TRAFFIC  INFORMATION 

(COTI) 


Figure  2.-  CDTI  system  elements. 
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Figure  3.-  Pilot  rating  of  range  and  bearing  noise 


(a)  Constant  time  delay  cue. 


(b)  Constant  time  predictor  cue. 


Figure  9.-  CDTI  format  from  time-based  self-spacing  techniques  study. 
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Figure  11.-  CDTI  format  used  in  TCV  flight  tests 
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Figure  12.-  Spacing  criteria. 
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Figure  13.-  Groundspeed  profiles  for  constant  distance  spacing 


GROU^^DSPEED. 

knots 


GROUNDSPEED, 

knots 


DISTANCE  TO  RUNWAY  THRESHOLD,  n.  mi. 

Figure  14.-  Groundspeed  profiles  for  time  predictor  spacing. 
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Figure  15.-  Groundspeed  profiles  for  time  delay  spacing. 
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Figure  T6.-  Effect  of  pilot  spacing  technique  on  interarrival  time  at 
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Figure  17.-  Effect  of  groundspeed  resolution  on  interarrival  time  at 

the  threshold. 
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CHARACTERISTICS  OF  LEAD  AIRCRAFT 


Figure  18.-  Lead  aircraft  effect  on  interarrival  time  at  the  threshold. 


Figure  19.-  Probability  density  curves  for  Interarrival  time. 
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Figure  21.-  Approach  speeds  In  aircraft  queues. 
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A  Perspective  Display  of  Air  Traffic  for  the  Cockpit 
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AtSIBACI 

'^^^^^he  typical  format  of  the  cockpit  display  of  traffic  infor- 
ration  (CDTI)  has  been  the  pi an-v lew Altitude  has  been 
represented  numerically  or  by  shape “encod ing it  is  possible 
that  manuever  decisions  are  unfavorably  blasedr^nd  pilot  work¬ 
load  increased^by  this  kind  of  non-integrated  format. 

As  an  alternative*  a  perspective  display  has  beer,  developed. 
This  traffic  display  presents  a  more  natural  view  of  the  airspace 
around  an  aircraft.  Perspective  depth  cues  provide  a  sense  of 
volume.  Reference  metrics  enhance  separation  judeements*  Par¬ 
ticular  emphasis  Is  placed  on  vertical  separation.  A  flexible 
computer  graphics  program  drives  the  dynamic  vector  graphics 
display  In  real-time*  allowing  Interactive  development  of  the 
optimum  viewing  geometry. 

The  perspective  and  plan-view  CDTI  displays  will  be  compared 
In  experiments  to  be  conducted  In  the  summer  of  19f2.  Further 
experiments  will  examine  the  ability  of  pilots  to  derive  accurate 
mental  models  of  spatial  conf igure t Ions  from  perspective 
displays*  as  a  function  of  viewing  geometry. 

ItllBQtUCIiab  ^ 

For  the  last  several  years*  NASA  and  the  FAA  have  been 
studying  the  concept  of  a  cockpit  display  of  traffic  information 
(CDTI).  The  study  of  CDTI  display  formats  Is  a  part  rf  the  human 
factors  research  of  cockpit  technology  .it  NASA's  Ames  Research 
Center.  The  traditional  format  of  CDl I  has  been  a  plan-view* 
with  altitude  represented  numerically  Ir  data  tags.  Seme  recent 
efforts  have  been  made  to  encode  altitude  by  shape. 

Fxpsr  i  menters  at  Air.es  who  are  studying  pilot  maneuver  deci¬ 
sions  using  plan-view  displays  have  beceme  concerned  that  the 
plan-view  may  bias  pilots'  manuever  decisions.  A  better 
representation  of  altitude  was  sought. 


EtSSEttllYE  QlSELAl 


Informal  analysts  of  projective  display  tecfrlques  sug- 
^■»‘sted  that  orthooraphlc  projection  mlrht  be  preferable  to  per¬ 
spective.  The  vertical  dimension  could  represent  altitude,  and 
the  horizontal  dimension  could  be  either  alorg-track,  or  perpen¬ 
dicular  to  It.  This,  however,  still  requlreo  encoding  of  the 
third,  collapsed  dimension.  Other  positions  for  the  plane  of 
projection  would  negate  much  of  the  metric  benefit  of  ortho¬ 
graphic  orojectlon. 

Perspective  was  then  considered  more  seriously.  Its  advan¬ 
tage  Is  that  It  Is  mere  natural,  and  may  have  some  benefit  for 
spatial  judgements.  Its  disadvantage  Is  that  metric  information 
is  difficult  to  derive  from  such  a  display.  To  overcome  this 
problem,  a  key  element  was  the  development  of  uncluttered  metric 
symbology. 

As  an  attempt  to  provide  a  better  representation  of  the  air¬ 
space  for  CPT I  experiments*  an  interactive  perspective  display 
program  was  developed. 

EtUIEHENI 

The  use  of  vector  graphic  equipment  Imposes  a  limitation  on 
the  representation  options  available,  but  also  provides  real-time 
performance.  The  vector  display  orogram  that  has  beer  developed 
allows  not  only  real-time  traffic  dynamics,  but  else  real-time 
interaction  with  the  display  parameters.  This  allows  display 
development  to  be  done  Interactively,  minimizing  the  number  of 
Iterations  through  the  cycle  of  specification  and  programming. 
It  also  provides  Immediate  feedback  when  varying  the  perspective 
parameters  so  that  the  contributions  of  each  one  to  cur  particu¬ 
lar  needs  can  be  assessed. 

The  display  program  is  written  In  LKSI  Pascal  and  runs  on  a 
rrP-11/70  ml n i -computer  under  the  PSX-llM  cperatlnp  system.  The 
display  device  Is  an  Fvans  and  Sutherland  Picture  System  2  (PS- 
?).  which  provides  Fortran  subroutines  that  are  called  from  the 
Pascal  program.  Interaction  with  the  program  Is  via  a  TEC  VT-100 
video  display  terminal.  PS-2  function  switches  (toggle  and  momen¬ 
tary  action),  and  data  tablet.  Hardcopies  may  be  made  cn  a  Ver- 
satec  electro-static  pr Inter/p letter « 

The  display  samples  In  this  paper  were  done  on  the  Versatec. 
Line  qualities  of  the  actual  PS-2  display  and  the  hardcopies 
differ  In  several  ways.  Vectors  drawn  by  the  Versstec  are  black 
on  white,  while  vectors  In  the  actJal  display  are  drawn  In  a 
range  of  intensities  cn  a  dark  background.  The  judlclcus  use  of 
symbol  Intensities  and  Intensity  gradients  Is  useful  on  the 
actual  display  for  reducing  visual  clutter*  but  our  hardcopy  dev¬ 
ice  does  not  support  this  necessary  feature.  Also,  the  vertical 
alignment  of  dashed  lines  In  the  hardcopies  can  cause  some 
effects  not  orcsent  In  the  actual  display. 
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aSEL41  tQUIEyi 


The  display  presents  a  perspective  vice  of  the  traffic  sur- 
rourxjing  ownshlp,  with  the  ownship  syrr.bol  at  the  renter  of  the 
screen  (fig.  la-c«e).  The  exact  position  of  each  aircraft  is 
represented  by  the  nose  point  of  the  symbol. 

Alucaft  are  a !  rcraft -shaped*  and  can  represent 
various  a/c  types.  The  size  if  the  ownship  symbol  is  specified 
as  a  fraction  of  the  display  width  end  remains  constant  regard¬ 
less  of  viewing  geometry.  The  sizes  of  the  othci  syirtols  vary  as 
a  function  of  perspective  and  distance  from  the  eye.  Thus*  air¬ 
craft  sy'nbols  on  the  near  side  of  ownship  appear  slightly  larger; 
those  on  the  far  side  appear  slightly  smaller.  The  size  differ¬ 
ence  depends  upon  the  degree  of  perspective  distcrticn  esta¬ 
blished  for  the  paiticul.!'  scene. 

^  bSCiJfiDtal  LClfiCiDCfi  aild  is  centered  beneath  cv»nship  and 
is  oriented  so  that  one  axis  t-f  the  grid  is  aligned  with 
cwnshlp*s  heading.  Grid  lines  are  separated  by  a  standard  dis¬ 
tance*  typically  2  or  3  nautical  miles.  Grid  lines  perpendicular 
to  the  flight  path  move  underneath  cwnship  at  ownship *s  forward 
speed*  providing  a  sense  of  forward  motion.  The  grid  vectors  are 
brightest  near  cwnship  and  beccme  dimmer  with  depth  Into  the 
scene.  This  eliminates  the  clutter  near  the  horizon  that  is  evi¬ 
dent  in  the  hardcopies. 

telxlc  1Iqc&*  orthogonal  to  the  grid*  connect  three  points 
cf  Interest;  the  aircraft  position  In  three  dimensions*  the  hor¬ 
izontal  position  cn  the  ruled  grid*  and  the  point  that 
corresponds  to  ownship's  altitude*  at  that  position  (fig.  Id). 
The  ownsh l p-al t i tude  intersection  at  each  other-aircraft  position 
is  marked  with  an  'x**  and  the  vertical  separation  distance  Is 
ruled  with  thousand  ^oot  reference  tics.  The  aircraft  symbols* 
tics  and  * k'  are  drawn  with  bright  vectors. 

A  data  tag  is  associated  with  each  other-aircraft  and  may 
contain  any  combination  of  information  required*  typically  Iden¬ 
tity*  altitude  and  vertical  speed.  The  oosltlon  of  each  tag 
within  the  three  dimensional  scene  is  solved  in  two  cimcnsions  on 
the  plane  of  projection  by  a  oclcclllf  alacfiDEDt  aLgcLltblB  (fig. 
2)  which  ensures  that  the  tag  Is  in  a  readable  ( ncn-cver I app lag ) 
position.  The  algorithm  considers  the  projected  positions  of  all 
aircraft  symbols#  metric  lines*  and  ether  data  taps.  It  than 
selects  the  best  free  screen  position  near  the  appropriate  air¬ 
craft  symbol*  based  on  a  or  lorlty  scheme.  The  pr ferities  rank 
the  preferred  positions  of  the  tag  relative  to  the  aircraft  sym¬ 
bol*  and  may  be  changed  interactively.  Tags  are  drawn  with 
bright  vectors  and  stand  out  well  arainst  the  backgreund. 

One  version  of  the  traffic  display  program  Incorporates 
sixty-second  trajectt'ry  ccedlclQti  and  history  dots.  The  latest 
addition  to  this  procram  puts  tics  and  the  ownsh Ip-al t itude  'x' 
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on  the  .Tietrlc  line  at  the  end  of  the  predictor#  as  an  aid  to 
Judgements  of  future  vertical  position  (flq.  Id). 

rnttltiC  SEDMEIRl 

viewing  geometry#  which  determines  the  appearance  of  the 
display#  is  the  specification  of  the  position  of  the  eye  within 
the  space#  and  the  3C  space  to  be  projected  onto  the  2V  screen. 

The  position  of  the  eye  Is  variable  In  real-time.  It  may  be 
positioned  anywhere  within  a  hemisphere  centered  on  cwnshlp#  at 
cr  aboye  ownship's  altitude  plane.  The  surface  of  a  hemisphere  of 
selected  radius  is  mapped  onto  the  data  oad#  which  alloivs  move¬ 
ment  cf  the  eyepoint  over  this  surface  by  moving  the  stylus  over 
the  pad.  Dwnshlp  Is  always  the  point  of  regard.  A  forward-looking 
view  which  provides  the  best  horizontal  and  vertical  resolution 
Is  preferred. 

Specification  of  the  viewing  geometry  tflg.  3)  rrculres  that 
an  approximation  to  a  cone  of  vision,  called  a  viewing  frustrum# 
he  established.  Three  parameters  of  this  frustrum  are  considered 
here  s 

fovi  flelo  of  view  or  viewing  angle#  determ.lnes  the 
amount  of  convergence  of  parallel  lines# 
wc!  the  distance  between  the  eye  and  ownship; 

The  frustrum  Is  a  30  "window*#  and  the  eye-distance 
Is  one  of  Its  parameters#  hence  "we"  In  PS-?  jargon, 
range:  the  minimum  distance  between  ownsMp  and 

the  nearest  clipping  plane  (side  of  the  frustrun)# 
which  Is  the  closest  that  other  objects  can  be  to 
ownship  without  entering  the  displayed  region. 

The  data  pad  may  be  used  to  vary  the  viewing  geometry  In 
real-time.  hy  selecting  appropriate  modes  with  the  function 
switches,  the  fov#  we  or  range  may  be  held  constant  while  manipu¬ 
lating  the  others  via  the  pad. 

A  constant  viewing  angle  allows  the  convergence  due  to  per¬ 
spective  to  be  held  constant  while  changing  the  amount  of  area 
displayed  around  ownship.  A  constant  eye-to-ownsh I p  distance 
allows  the  size  gradient  of  symbols  with  respect  to  depth  to  be 
held  relatively  constant  while  changing  the  convergence  and 
range.  A  constant  range  allows  a  constant  minimum  local  region 
to  be  displayed  around  ownship  while  changing  the  perspective 
distort  Ion. 

Thus#  the  viewing  geometry  of  the  eye  point  and  the  perspec¬ 
tive  Is  easy  to  manipulate#  allowing  the  spatial  relationships  in 
the  display  to  be  arranged  as  desired.  This  Is  Important  because 
the  Information  In  the  display  must  be  accurately  perceived#  and 
the  effects  of  the  various  perspectlv  parameters  must  be  con¬ 
sidered. 

For  example#  the  perceived  proximity  of  an  Intruder  varies 

517 


.  I 

■  '"i 


as  a  function  of  the  viewinq  geometry*  end  the  global  scalino  of 
the  symbols.  At  any  particular  scale  setting*  the  geometry  may 
he  manipulated  to  obtain  the  desired  perception  of  threat  (fig. 
label. 


When  a  particular  viewing  geometry  Is  found  to  be  of 
Interest*  one  of  a  set  of  eight  •style**  switches  may  be  defined 
so  that  all  of  the  parameters  may  be  set  with  a  single  switch* 
Any  number  of  style  sets  may  be  defined  and  stored  as  files  for 
later  use* 

The  program  has  a  primitive  trajectory  generator  which 
drives  all  of  the  aircraft  symbols.  Once  a  file  of  Initial  posi¬ 
tions*  headings  and  rates  are  Input*  motions  of  the  syirbols  are 
generated  for  as  long  as  needed.  Trajectories  may  he  straight  or 
variably  curved*  with  selectable  vertical  speeds.  The  dynamics 
may  be  stopped  and  restarted  at  any  time  so  that  different 
viewing  geometries  may  be  assessed  In  different  situations. 

CItlE.a  ltiIL&ACIIX£ 

A  snapshot  switch  allows  hardcopies  to  be  made  as  the 
display  program  runs.  Since  the  essential  viewing  geometry 
parameter  values  may  be  displayed  on  the  screen  by  switch  selec¬ 
tion*  hardcopies  may  record  beth  the  appearance  and  the  underly¬ 
ing  geometry  of  any  display.  Other  switches  allow  elements  of 
the  display  to  he  erased. 

Static  Interaction  via  the  video  display  terminal  (VDT)  can 
he  selected  with  a  function  switch.  This  mode  of  Interaction 
allows:  direct  numerical  specification  of  all  parameters  of  the 
viewing  geometry,  output  of  the  matrices  that  embody  the 
ceometric  transformations;  output  of  the  30  coordlnatts  of  each 
aircraft;  adjustment  of  the  brightness  of  elements  In  the 
display;  change  of  the  symbol  scale*  selection  rf  traces  and 
dumps.  VDT  interaction  mode  also  allows  redefinition  cf  the  fol¬ 
lowing:  the  viewing  geometry  •'style**  switches;  grid  distances* 
orientation  and  motion;  aircraft  initial  conditions  and  trajec¬ 
tories;  tag  placement  priorities. 

fUIUEE  ELAtlE 

The  perspective  and  plan-view  CDTI  displays  will  be  compared 
In  experiments  tc  be  conducted  In  the  summer  of  19T2,  Further 
experiments  will  examine  the  ability  of  r  Hots  to  derive  accurate 
mental  models  of  spatial  configurations  from  perspective 
displays*  as  a  function  of  viewing  geometry*  This  should  allow 
us  to  further  evaluate  the  utility  of  perspective  displays  for 
Spatial  information  transfer. 
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ABSTRACT 

study  investigated  the  impact  of  cockpit  displays 
of  traffic  information  (CDTI)  on  the  flow  of  approach 
traffic.  A  mix  of  aircraft  type,  CDTI-equi ppage,  and 
type  of  air  traffic  control  (ATC)  were  included  in  the 
simulation.  In  addition,  the  practical  issue  of 
simulator  fidelity  in  conducting  such  experiments  was 
studied.  Seven  piloted  simulators  that  represented  a 
mix  of  general  aviation-type  and  transport-type  aircraft 
were  simulated  with  two  levels  of  control  fidelity.  They 
were  flown  by  four  teams  of  seven  pilots  each  under  ATC. 

A  computer-generated  target)  flying  a  predetermined 
flight  pathj^as  also  included  to  represent  aircraft  not 
in  contact^ with  ATC.  The  results  indicate  that 
aircraft  type  and  not  simulator  fidelity  influenced 
pilot  and  system  performance.  The  frequency  and  content 
of  communications,  several  measures  of  system 
performance,  and  pilot  ratings  also  reflected  pilot 
willingness  to  accept  closer  spacing  and  clearances  to 
follow  aircraft  seen  on  a  CDTI. 

K 

INTRODUCTION 

The  impact  of  providing  aircraft  with  cockpit  displays  of  traffic 
information  (CDTI)  on  the  national  airspace  could  be  as  limited  as 
providing  pilot  assurance  or  as  far  reaching  as  allowing  pilots  to 
assume  responsibility  for  maintaining  separation,  terminal  area 
merging,  and  detecting  air  traffic  control  (ATC)  system 
failures.  The  Impact  of  CDTI-equlpped  aircraft  on  the  division  of 
responsibility  between  the  air  and  ground  has  been  the  object  of 
research  for  years.  However,  in  order  to  make  meaningful  declsons 
about  the  advisability  of  including  CDTI  in  the  national  air 
system,  additional  research  is  needed  to  assess  the  potential 
benefits  and  liabilities  of  such  a  system.  The  benefits  might 
Include  increased  airport  capacity,  enhanced  safety,  improved  fuel 
management,  and  pilot  assurance.  The  liabilities  might  include 
increased  pilot  and  controller  workload,  increased  pilot  attention 
in  the  cockpit  rather  than  looking  out  the  window  and  the 
possiblity  that  pilots  might  take  unilateral  actions  based  on 
information  from  a  CDTI. 

Much  of  the  information  that  might  be  displayed  on  a  CDTI  is 
already  available  in  the  cockpit  from  a  variety  of  sources  inclu- 


ding  ATC,  charts.  maps,  weather  radar,  transmissions  of  other 
aircraft,  and  looking  out  the  window.  Although  this  information 
is  available,  it  is  not  integrated  or  presented  in  a  convenient 
form.  Thus,  CDTI  could  provide,  in  addition  to  traffic 
information,  relevant  navigation,  terrain,  and  weather  information 
presented  on  a  single  mul ti -f unct i on  display  with  a  common 
reference,  format  and  scale.  This  should  assist  pilots  in  forming 
mental  representations  of  their  environment  and  improving  their 
situation  awareness. 

Because  there  is  so  much  information  that  could  be  displayed  on  a 
CDTI,  and  so  many  ways  it  might  be  presented,  elimination  of 
obviously  unacceptable  alternatives  in  advance  of  simulation  and 
inflight  research  was  undertaken  by  Hart  and  Wempe  (ref.  1)  with  a 
pilot  opinion  survey.  Numerous  candidate  displays  that  incorpo¬ 
rated  different  categories  of  information  presented  with  varying 
levels  of  complexity,  symbology,  and  format  were  presented  to 
groups  of  pilots.  They  were  asked  to  evaluate  the  display 
features  and  to  specify  a  CDTI  that  incorporated  essential 
information  presented  with  minimal  clutter  and  confusion. 
Subsequent  part-  task  simulations  were  conducted  (refs.  2,  3)  to 
determine  whether  features  preferred  in  the  opinion  survey  would 
contribute  ^to  accurate  and  rapid  assessment  of  the  spatial 
relationship-,  between  a  pilot’s  own  and  another  aircraft.  Finally, 
a  simulatiorS.  that  included  multiple  piloted  simulators  and  ATC 
controllers  was  conducted  to  validate  the  earlier  experimental 
results  in  a  more  realistic  environment  (ref.  4).  The 
experimental  variables  included:  presence  or  absence  of  CDTI, 
symbolic  encoding  of  the  relative  altitude  of  other  aircraft,  and 
presence  or  absence  of  aircraft  flying  under  visual  flight  rules 
(VFR)  intermixed  with  aircraft  flying  under  instrument  flight 
rules  (IFR).  The  CDTI  features  that  were  simulated  included 
digital  readout  of  ground  speed,  altitude,  and  identification  of 
other  aircraft,  flight  path  predictors  and  flight  path  histories 
for  own  and  other  aircraft,  a  navigation  display,  and  pilot 
selectable  map  scale  and  orientation. 

The  purpose  of  the  current  study  was  to  investigate  further  the 
impact  of  VFR  aircraft  on  the  ATC  system  in  a  terminal  area  envi¬ 
ronment  in  which  all  or  some  of  the  IFR  aircraft  were  equipped 
with  a  CDTI.  Some  of  the  other  variables  considorod  were:  (1) 
whether  or  not  the  altitude  of  VFR  aircraft  was  known!  (2)  the 
effect  of  traffic  mix  (single-  or  twin-engine  light  aircraft  or  a 
jet);  and  (3)  the  impact  of  simulator  fidelity  on  the  behavior  of 
the  controllers  and  pilots.  Three  levels  of  slmuation  fidelity 
were  provided  from  pi  1 ot -control  1 ed  simulators  to  computer¬ 
generated  targets  flying  fixed  flight  paths.  This  issue  was 
introduced  to  determine  whether  the  differences  found  in  the 
earlier  simulation  (ref.  4)  between  the  number  of  clearance 
changes  and  vectors  given  to  simulators  with  limited  pilot  control 
as  compared  to  those  with  complete  pilot  control,  occurred  because 
of  differences  in  simulation  fidelity  or  because  the  simulators 
represented  general  aviation  or  transport  aircraft  respectively. 


METHOD 


Simulation  Facility 

The  eKporiment  was  conducted  in  the  mul t i  — cockpi t  -facility  at  Ames 
Research  Center.  The  computational  equipment  consisted  o-f  a  Digi¬ 
tal  Equipment  Corporation  PDP  11/70  computer  and  an  Evans  and 
Sutherland  Picture  System  II.  The  research  -facility  was  separated 
into  -four  areas:  <1)  three  enclosed  simulator  cabs;  (2)  four 
"pseudo  pilot"  stations;  <3)  an  ATC  station;  and  <4)  an  ex¬ 
perimenter's  station.  Communications  were  recorded  for  later 
transcription  and  experimental  runs  were  videotaped.  The  computer 
update  rate  was  10  times  per  second,  although  relevant  aircraft 
positions  and  pilot  Inputs  were  recorded  once  per  second. 

§i!Dulatgr  Cafes 

The  simulator  pilot  <SP)  cabs  contained  an  adjustable  aircraft 
seat,  throttle,  and  flap  levers,  communication  radio  tuner,  head 
set,  map  scale  selection  switch,  and  a  manual  control  stick  with 
trim  switch.  The  basic  information  necessary  for  IFR  flight  was 
presented  graphically  and  digitally  on  a  57.7  cm  Xytron  display 
centered  xn  front  of  the  pilot.  (Figure  1)  A  vertical  situation 
display  presented  information  about  altitude,  vertical  speed, 
heading,  indicated  airspeed,  ground  speed,  fuel  flow,  map  scale, 
pitch  attitude,  bank  angle,  raw  glideslope  and  localizer  devia¬ 
tion,  and  distance  from  the  destination  airport  (OME) .  All 
measures  were  computed  and  displayed  in  rautical  miles,  knots,  and 
feet,  as  these  are  the  units  of  measurement  used  in  aviation. 

A  12.5  cm  display  located  beneath  the  vertical  situation  display 
showed  significant  navigation  features  for  a  southern  approach  to 
San  Jose  Airport.  It  translated  and  rotated  beneath  the  symbol 
for  ownship  (a  chevron)  which  was  centered  laterally  and  displaces 
toward  the  bottom  of  the  display  with  a  heading-up  map  orienta¬ 
tion.  Five  discrete  map  scales  ranging  from  118  to  7  km  and  an 
automatic  mode  in  which  map  scale  varied  continuously  with  alti¬ 
tude  from  2  to  118  km  were  provided.  When  SPs  were  given  a 
traffic  display,  all  aircraft  within  map  range  and  a  pilot- 
selectable  range  above  or  below  the  pilot's  own  altitude  ware 
displayed.  Digital  data  tags  (identification,  ground  speed,  alti¬ 
tude,  and  direction  of  vertical  flight)  ware  provided  for  IFR 
aircraft  on  all  CDTI  trials  and  for  VFR  aircraft  as  well  when  they 
were  simulated  with  altitude  encoding  transponders.  The  shape  of 
the  symbols  that  represented  other  aircraft  depicted  the  relative 
altitude  of  those  aircraft:  a  full  hexagon  indicated  that  an 
aircraft  was  within  -♦■/-ISO  m  of  a  pilot's  own  altitude  and  the 
upper  or  lower  half  of  a  hexagon  indicated  that  it  was  more  than 
ISO  m  above  or  below  respectively.  This  discrete  relative  alti¬ 
tude  coding  had  bean  preferred  in  the  earlier  studies  (ref.  1, 
4).  If  altitude  for  a  VFR  aircraft  was  not  known,  this  aircraft 
was  displayed  at  all  times  as  though  it  was  at  the  same  altitude 
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as  ownship,  aasuming  the  worst  case.  Otherwise,  it  was  displayed 
according  to  the  same  algorithms  as  the  IFR  aircra-ft.  A  two- 
segment,  30-sec  -flight  path  predictor  and  -flight  path  history 
showing  four  previous  positions  each  B  sec  apart  were  added  to  the 
symbols  for  own  and  other  aircraft. 

Eilst  §ta;tign 

The  term  "pseudo  pilot"  does  not  refer  to  the  qualifications  of 
the  operators  (all  were  instrument-rated  general  aviation  pilots) 
but  rather  to  the  simple  controls,  displays,  and  aircraft  models 
provided  for  these  pilots.  The  movement  of  these  aircraft  across 
the  pilots’  and  controllers’  traffic  displays  was,  however,  iden¬ 
tical  to  that  of  the  more  relistically  modeled  and  controlled 
simulator  cabs.  The  communications  and  procedures  followed  were 
i  F4af->4- i  I- 2 1  Tho  r» «»(jid Q- p i  1  ot s  ( PP )  wcr 6  included  in  the  Simula- 

controllers.  to  i 


Figurs  2:  ATC  and  pseudo  pilot  traf-fic  display. 


area  south  o-f  the  San  Francisco  Bay  Area  controlled  airspace  which 
was  identical  to  the  map  portion  a4  the  PP  display.  (Figure  2) 
Each  controller  was  given  a  headset,  microphone,  and  radio  fre~ 
quenc  y  selector. 

Sgenarigg 

The  simulation  was  based  on  a  southern  approach  to  runway  30L  at 
San  Jose  Airport.  The  location  and  names  of  some  of  the  waypoints 
were  modified  to  create  three  converging  routes  with  reporting 
points  located  at  equal  distances  from  the  airport  along  the 
routes.  Aircraft  entered  the  simulation  at  one  of  seven  waypoints 
located  65,  46,  or  35  km.  from  the  airport.  The  descent  from 
the  LICKE  intersection  to  the  airport  (DUE  16)  was  based  on  a 
standard  approach  plate  for  runway  30L.  The  localizer  and  glide- 
slope  were  intercepted  at  LICKE  for  a  simulated  instrument  landing 
system  (ILS)  approach. 

Appropriate  initial  altitudes  and  starting  speeds  were  programmed 
for  the  three  aircraft  typos  and  the  different  starting  locations. 
Entry  into  the  system  was  scheduled  to  simulate  routine  handoffs 
from  an  enroute  control  facility.  Longitudinal  separation  of  at 
least  9  km  for  aircraft  at  the  same  altitude  or  a  vertical  separa¬ 
tion  of  at  least  1200  m  for  aircraft  at  the  same  position  was 
provided  as  an  initial  condition.  The  end  of  each  run  occurred 
when  the  last  aircraft  landed. 

Twenty  different  scenarios  were  developed  that  represented  four 
levels  of  VFR  aircraft  intrusion.  Four  were  used  for  practice 
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presented  with  each  of  the  four  e>:peri mental  conditions  and  the 
remaining  16  were  used  twice:  once  when  all  aircraft  were  CDTI- 
equipped  and  again  when  only  PPs  were  given  a  traffic  display.  No 
scenario  was  used  more  than  one  time  for  any  group.  The  different 
combinations  of  task  difficulties  generated  by  initial  condition, 
VFR  aircraft  path,  and  traffic  mix  were  presented  in  a  balanced 
order  between  and  within  groups. 

VFR  flight  paths  were  created  in  the  simulator  cabs  in  advance  of 
the  simulation  and  played  back  at  predetermined  times  to  allow 
controlled  recreation  of  situations  typical  of  the  San  Jose  area. 
These  aircraft  were  not  in  contact  with  ATCl  as  they  were  flying 
under  VFR  outside  controlled  airspace. 

tj§fegQ?lQLo9i.cal  Condi.ti.gnf 

Eight  different  Airport  Terminal  Information  Service  (ATIS)  mes¬ 
sages  were  recorded  to  provide  information  appropriate  for  each 
approach.  Marginal  meteorological  conditions  with  wind  from  the 
west  or  east  at  46  km/hr  decreasing  to  20  km/hr  across  the  runway 
with  low  turbulence  and  no  shear  were  presented  in  a  balanced 
order  across  experimental  conditions. 

Models 

Two  cabs  were  configured  as  medium  jet  transports  and  one  as  a 
twin-engine  light  aircraft.  The  simulator  cab  models  (ref  5)  were 
based  on  principles  o*  fundamental  fluid  dynamics  with  parameters 
that  represented  particular  aircraft  features  or  mechanics.  The 
goal  was  to  balance  simplicity  (for  manageabi I i ty )  against 
complexity  (for  realism)  to  provide  for  significant,  observable 
effects  to  pilots  rather  than  to  produce  a  faithful  reproduction 
of  the  aerodynamics  involved.  The  model  provided  a  full  operating 
range  from  cruise  to  landing  for  many  aircraft  simultaneously.  PP 
aircraft  were  altitude-configured  to  fly  like  one  single-engine  or 
two  twin-engine  light  aircraft  or  a  medium  jet.  Commanded  changes 
were  achieved  by  rule-of-thumb  algorithms,  turns  were  standard 
rate  and  coordinated,  climb  and  descent  rates  were  constant,  and 
nominal  profiles  were  appropriate  for  the  aircraft  type  (ref. 6). 


E^Berimental.  Variables 

All  aircraft  were  equipped  with  CDTI  displays  on  one  half  of  the 
trials  (allCDTI).  PPs  but  not  SPs  were  given  a  traffic  display 
(someCDTI)  on  the  rest-  On  half  of  the  allCDTI  or  someCDTl 
trials,  VFR  aircraft  without  altitude  encoding  transponders  were 
simulated,  and  thus  no  altitude  information  was  displayed 
(noTAG) .  On  the  remaining  trials,  altitude  information  for  VFR 
traffic  was  displayed  to  whomever  was  given  a  traffic  display  for 
that  trial  (TAG).  Two  replications  of  each  of  the  four  experimen¬ 
tal  conditions  were  obtained!  one  with  minimal  VFR  traffic  inter¬ 
ference  and  one  with  considerable  interference. 
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Su^j.ects 


Four  instrument-rated  general  aviation  pilots  served  as  PPs  tor 
each  grouD.  One  general  aviation  pilot  and  two  current  transport 
pilots  flew  the  simulators.  h  recently  retired  air  traffic  con¬ 
troller  and  a  specially  trained  instrument-rated  pilot  served  as 
the  approach  and  tower  controllers  respectively.  Four  groups  of 
seven  pilots  and  two  controllers  each  served  as  paid  participants. 

Prgcedure 

Each  of  the  four  experimental  groups  was  familiarized  with  the 
purpose  of  the  experiment,  their  role  in  it,  and  given  several 
hours  of  practice  flying  the  simulators  on  the  day  before  the 
experiment.  Four  additional  practice  runs  were  conducted  on  the 
morning  of  the  experiment  fallowed  by  eight  experimental  runs  in 
the  afternoon.  Each  practice  or  experimental  run  lasted  25-30  min 
and  consisted  of  a  VFR  flight  and  seven  approaches  by  four  PPs 
and  three  SPs.  SPs  completed  a  questi onnnai re  at  the  conclusion 
of  each  approach  and  again  at  the  end  of  the  entire  experiment  to 
obtain  their  opinions  about  the  scenarios,  displays,  CDTI,  the 
simulation,  their  own  performance,  and  the  workload  experienced. 

Written  Materials 

All  participants  were  given  an  area  map  and  an  approach  chart  for 
an  ILS  approach  to  runway  30L  at  San  Jose  Airport.  PPs  and  SPs 
were  given  information  about  the  operating  characteristics  of 
their  aircraft  and  a  nominal  descent  profile.  The  controllers 
were  given  "flight  data  "  strips  for  each  aricraft  before  it 
entered  the  terminal  area  and  the  pilots  were  given  written 
"clearances"  with  the  time  and  place  of  their  entry  into  the 
simulation  and  their  initial  speed  and  altitude.  SPs  were  also 
given  a  set  of  rating  scales  to  completed  after  each  approach. 
Fourteen  of  the  scales  presented  task-related,  operator-related, 
and  performance-related  dimensions  in  a  bipolar  format.  Three 
additional  scales  developed  by  Airbus  Industrie  for  use  in  certi¬ 
fication  (ref.  7)  were  tested  that  asked  SPs  to  rate  the  frequency 
of  interruptions,  amount  of  free  time  and  likelihood  of  errors. 

RESULTS 

Measures  of  pilot  effort,  pilot  performance,  system  efficiency, 
and  safety  were  analyzed  to  determine  the  effect  of  information 
about  VFR  aircraft  and  presence  of  absence  of  CD! Is  in  all  air¬ 
craft  on  a  variety  of  performance  indicators.  In  addition,  pilot 
responses  to  several  forms  of  subjective  rating  scales  were  ob¬ 
tained  to  evaluate  the  impact  of  these  parameters  on  the  pilots. 
All  measures  were  examined  initially  for  differences  among  experi¬ 
mental  groups  with  a  series  of  one-way  analyses  of  variance  for 
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lnd«p«ndent  groups.  No  signi-ficant  group  di-f  +  erencea  were  found 
for  any  measure,  so  the  remaining  analyses  were  performed  across 
individual  SPs  (n  ■  12)  or  PPs  <n  =  16).  The  effects  of  display 
conditions  and  replications  on  each  of  the  measures  were  examined 
with  three-way  analyses  of  variance  for  repeated  measures. 
Individual  pilot  performance  measures  such  as  localizer  and 
glideslope  deviations  were  not  examined  in  great  detail  because 
the  quality  of  the  simulation  did  not  warrant  such  an  analysis 
and  it  had  been  shown  previously  (ref.  4)  that  such  measures  did 
not  reflect  variations  in  display  and  system  parameters  such  as 
those  under  investigation. 

System  Perf Qcmancf 

Four  measures  of  system  performance  were  studied:  (1)  separation 

violationsji  (2)  intercrossing  times;  (3)  duration  of  approaches; 
and  (4)  communications.  For  these  analyses  as  well  as  others,  the 
effect  of  the  experimental  variables  was  examined  for  the  system 
as  a  whole,  for  the  different  aircraft  types  (single  or  twin 
engine  light  aircraft  or  medium  jet)  and  for  the  two  levels  of 
simulator  fidelity  (SP  and  PP). 

yiSiStiQQS 

Four  levels  of  separation  violation  severity  were  selected  in 
advance  of  the  simulation  to  reflect  four  levels  of  system 
failure.  The  levels  ranged  from  slightly  less  than  standard  IFR 
separation  (Class  1)  to  a  collision  (Class  4)  The  frequencies  of 
separation  violations  by  experimental  condition,  simulator  type 
and  aircraft  type  were  computed  excluding  any  violations  that 
occurred  between  a  PP  aircraft  and  any  other  aircraft  after  the 
automatic  landing  system  had  taken  control  of  the  PP  aircraft.  As 
no  control  of  those  aircraft  was  possible  after  that  point, 

separation  violations  did  occur,  but  as  a  consequence  of 

simulation  limitations  rather  than  system  failures.  Of  the 
remaining  violations,  more  instances  of  less  than  standard 
separation  occurred  with  CDTI  in  all  aircraft  (on  6X  of  allCDTI 
approaches)  than  when  only  some  airraft  had  CDTIs  (on  2X  of  these 
approaches),  possibly  indicating  pilot  willingness  to  accept 
closer  spacing  with  CDTI  than  without.  (Table  1)  More  separation 
violations  occurred  with  at  least  one  aircraft  that  was  not  under 
ATC  control  (on  19*/.  of  VFR  approaches)  than  between  two  aircraft 

that  were  (on  3%  of  all  IFR  approaches).  Fewer  violations 

occurred  between  two  PP  aircraft  (on  3X  of  PP  approaches)  than 
with  one  or  two  simulators  (on  3'/.  of  SP  approaches).  No 
collisions  occurred  during  the  simulation. 

iQtgCSCOSSiDQ  li'Dgs 

The  mean  intercrossing  times  between  aircraft  at  the  LICKE  inter¬ 
section  and  the  outer  marker  were  computed  as  measures  of  system 
efficiency  and  safety  under  different  experimental  conditions. 
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TABLE  l:  Separation  Violations  that  occurred  between  two  or  more 
aircra-ft  during  256  approaches  (Class  1  to  4  respectively  denotes 
an  increasing  severity  of  loss  of  separation  from  less  than  stan¬ 
dard  separation  to  a  collision) 


IMPACT 

OF  COT I 

IMPACT  OF  VFR 
AIRCRAFT 

SIMULATOR  FIDELITY 

Some 

A1 1 

VFR/IFR 

IFR/IFR 

Pseudo 

Si mul ator 

CLASS 

1 

1 

2 

2 

1 

2 

2 

CLASS 

2 

1 

4 

3 

2 

1 

4 

CLASS 

3 

0 

O 

1 

4 

1 

2 

CLASS 

4 

0 

0 

0 

0 

0 

0 

Two  three-way  analyses  of  variance  for  repeated  measures  were 
performed  on  the  mean  group  interci  ossing  times.  (Figure  3) 
Aircraft  spacing  was  less  with  allCDTIs  than  with  someCDTIs  (105 
vs.  94  sec)  and  less  with  altitude  information  for  VFR  aircraft 
than  without  (110  vs  89  sec)  at  the  LICKE  intersection.  These 
differences  ware  not  statistically  significant,  however.  All 
differences  related  to  displays  were  eliminated  by  the  outer 
marker.  Intercrossing  times  were  12  sec  longer,  on  the  average, 
at  the  outer  marker  than  at  the  LICKE  intersection,  as  all  air — 
craft  were  established  on  the  ILS,  and  had  achieved  approxi¬ 
mately  9.25  km  (5  n  mi )  separation  by  that  point  to  allow  for 


Figure  3:  AVERAGE  INTERCROSSING  TIMES  (tec) 
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dlf+er^ncBB  in  approach  speeds  among  the  aircraft.  There  were  no 
significant  replication  effects  at  either  location  nor  any 
interactions  among  ewperimental  conditions. 

6EBC9i!£tl  QyC3ti.QDS 

Average  approach  durations,  in  time  and  distance,  were  analyzed 
with  two  three-way  analyses  of  variance  for  repeated  measures. 
The  simulation  scenarios  had  been  set  up  so  that  all  jets  and  most 
twin-engine  light  aircraft  were  initialized  at  a  distance  of  65  km 
<35  n  milalong  the  routes  from  the  airport.  Additional  miles 
flown  might  thus  serve  as  a  rough  indicator  of  path  stretching  and 
delaying  maneuvers  given  by  ATC.  The  average  distance  flown  by 
the  twin-engine  aircraft  was  greater  than  the  jets,  indicating,  as 
did  the  communications  analysis  that  these  aircraft  received  more 
vectors  from  ATC.  There  was  a  reduction  of  3  n  mi  in  the  dis¬ 
tance  flown  by  light  twins  with  the  addition  of  information  about 
the  altitude  of  VFR  aircraft  and  a  similar,  but  smaller,  reduction 
with  the  addition  of  CDTIs  for  all  aircraft.  There  was  no  such 
difference  in  distance  flown  for  jets  as  a  function  of  display 
condition,  indicating  that  ATC  focused  on  the  general  aviation 
aircraft  rather  than  the  jets  when  flight  path  modifications  were 
required  for  separation.  The  single  engine  aircraft  flew  the 
shortest  distances,  primarily  because  they  typically  entered  the 
system  from  a  point  much  closer  to  the  airport  than  the  rest. 
These  aircraft  were  typically  vectored  off  of  the  final  approach 
course  to  expedite  faster  traffic  and  then  b’~ought  back  on  later. 
The  addition  of  CDTIs  in  all  simulators  resulted  in  shorter  ap¬ 
proaches  for  these  aircraft,  as  it  did  for  the  others,  but  no  such 
difference  was  found  when  altitude  information  was  given  for  VFR 
aircraft.  The  reduction  of  distance  traveled  per  approach  as  a 
function  of  some  (36  n  mi )  or  allCDTIs  (35  n  mi)  was  significant 
across  all  aircraft  types  (F  *  6.23  (1,6)  p  <.05).  No  significant 
differences  were  found  for  VFR  data  tag  conditions  or  replications 
and  there  were  no  significant  interactions. 

As  one  would  expect,  the  length  of  time  taken  to  complete  an 
approach  was  not  the  same  for  the  three  aircraft  types  due  to 
differences  in  approach  and  landing  speeds.  PP  flight  times  were 
longer,  on  the  average,  as  three  of  the  four  PP  aircraft  were 
simulated  as  slower  general -avi at i on-type  aircraft.  There  were  no 
differences  in  flight  times  as  a  function  of  either  display  condi¬ 
tions,  nor  any  significant  interactions.  There  was  a  significant 
decrease  in  average  flight  time  from  14.0  to  13.6,  min  as  the 
experiment  progressed  (F  ®  9.73  (1,6)  p  <.0l)  possibly  reflecting 
increased  system  efficiency  with  practice. 

Commun^cgt  i.gns 

All  communication  between  pilots  and  controllers  were  recorded, 
however  four  trials  were  lost  for  Group  4  due  to  faulty 
equipment.  Consequently,  the  communications  were  not  subjected  to 
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statistical  analysis.  Averages  tor  the  remaining  data  and  the 
trends  that  were  observed  will  be  described.  however,  because  o-f 
the  important  role  that  communications  plays  in  this  type  of 
simulation. 

Communications  were  '  ^  icted  realistically  by  all  participants, 
providing  not  only  -  iportant  element  in  creating  a  realistic 
environment  but  also  o  valuable  source  of  information  about  the 
effects  of  the  experimental  variables  on  the  ATC  system.  A 
content  analysis  was  performed  by  playing  back  the  videotapes  and 
scoring  the  number,  types,  source,  and  destination  of  each  message 
using  a  modification  of  the  categorization  scheme  developed  by 
Chappell  and  Kreifeldt  (ref.  6).  Since  many  transmissions  conveyed 
several  different  types  of  information,  the  number  of  messages 
transmitted  was  greater  than  the  number  of  separate  transmissions. 
The  categories  included:  specific  types  of  traffic-related  mes¬ 
sages,  types  of  ATC  commands,  vectors  or  questions  about  them, 
position  reports,  requests  to  maintain  current  status,  and 
acknowl edgements. 


Table  2:  Mean  number  of  messages  transmitted  by  pilots  or 
controllers  on  each  approach  as  a  function  of  display  condition. 


TOPIC 

OF 

MESSAGE 

FROM 

CDTI 

some  all 

PILOTS 

VFR 

noTAG  TAG 

TOTAL 

FROM 

CDTI 

some  al 1 

CONTROLLERS 

VFR 

noTAG  TAG 

TOTAL 

TRAFFIC 

4.  1 

4.4 

0*  ■  0 

4.8 

8.S 

3a  3 

6.  8 

3.9 

6.3 

10.  1 

ALTITUDE 

7,  3 

7.2 

6.9 

9.7 

14.5 

13.  7 

15.4 

13.5 

15.5 

29.  1 

SPEED 

2.2 

1.7 

1.8 

1.9 

3.9 

14.3 

11.1 

13.4 

12.0 

25.4 

CLEARANCE 

.  7 

.  7 

1.8 

1.9 

1.4 

20.0 

22.5 

21.7 

20.8 

42.5 

VECTOR 

- 

- 

- 

- 

- 

15.  1 

12.  7 

13.8 

14.0 

27.8 

POSITION 

22.  1 

17.5 

21 . 1 

18.6 

39.6 

10.  1 

7.  1 

10.2 

7.0 

17.2 

MAINTAIN 

,  1 

1.7 

.  6 

1.2 

1.8 

9.6 

9.  7 

10.4 

9.0 

19.4 

ROGER/ 

63.3 

57.9 

59.  0 

62.4 

121.2 

14.5 

13.2 

14.7 

13.0 

37.  7 

READBACK 

TOTAL 

99.  e 

91. 1 

93.  2 

97.3 

190.5 

100.  6 

98.5 

101.6 

97.6 

199.  2 
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Th*  total  numbor  o-f  maasagas  transmittad  batwean  pilots  and  con¬ 
trollers  and  massages  specifically  related  to  traffic  may  be  seen 
in  Table  2.  On  the  average,  nearly  200  massages  were  transmitted 
by  the  two  controllers  and  seven  pilots  during  each  set  of 
approaches.  Although  there  were  an  approximately  equal  number  of 
massages  originating  with  the  axr  and  ground,  the  information 
content  was  quite  different.  More  than  twice  as  many  altitude, 
speed,  clearance,  and  vector  commands,  queries,  and  responses 
originated  with  ATC  as  from  the  pilots.  Twice  as  many  position- 
related  messages  originated  with  the  pilots  as  with  the  control¬ 
lers,  and  four  times  as  many  acknowledgements.  All  of  the  control¬ 
ler  acknowledgements  were  simple  "rogers",  where  as  the  majority 
of  the  pilots'  involved  a  complete  or  partial  readback. 

In  general,  there  were  fewer  transmission  with  all  CDTIs  than 
someCDTIs  <200  versus  189).  This  was  attributable  to  fewer  vectors 
issued  from  ATC  and  fewer  position-related  transmissions  from 
pilots  (Table  2).  For  those  messages  specifically  related  to 
traffic,  however,  the  reverse  was  true.  There  were  more  traffic- 
related  messages  when  all  pilots  had  traffic  displays  (7.4)  than 
when  or  ly  some  pilots  had  them  (11.2).  It  was  apparent  that  ATC 
did  use  the  pilot's  ability  to  see  other  aircraft  on  the  CDTI  when 
it  was  available  to  involve  pilots  in  maintianing  "visual"  separa¬ 
tion  by  giving  traffic  advisories  and  clearances  to  follow  other 
aircraft,  and  directing  pilots  to  maintain  separation  from  air — 
craft*  In  general,  the  additon  of  VFR  data  tag  Information,  had 
less  impact,  although  the  number  of  position-related  messages  did 
decrease  from  31  to  25,  on  the  average,  with  its  addition. 

Table  3  presents  the  communications  analysis  by  e^xperi mental  con¬ 
dition,  aircraft  type,  and  topic,  with  messages  to  and  from 
pilots  combined.  Pilots  of  single  engine  PP  aircraft  were  given 
and  initiated  the  fewest  communications.  This  is  consistent  with 
the  observation  that  ATC  vectored  these  aircraft  out  of  the  way 
of  the  faster  traffic  and  ignored  then  until  other  faster  air¬ 
craft  had  passed.  Their  most  frequent  type  of  communication  was 
a  command  to  maintain  present  status  or  a  readback. 

Both  PP  and  SP  twin-engine  aircraft  were  given  more  vectors  than 
any  other  commmand,  and  received  and  provided  a  number  of  position 
queries.  Both  types  of  communications  were  most  evident  when 
information  about  the  altitude  of  the  VFR  aircraft  was  not  known 
and  there  were  no  traffic  displays,  in  the  simulators.  In  addi¬ 
tion,  there  were  a  large  number  of  "maintain..."  commands  given  to 
these  aircraft  in  the  noTAG,  allCDTI  condition. 

The  pilots  of  the  jets  participated  in  relatively  fewer  communi¬ 
cations  than  did  the  pilots.  In  general,  the  presence  or  absence 
of  altitude  information  for  VFR  aircraft  affected  tne  frequency  of 
responses  made  by  jet  pilots  differently  depending  on  whether  or 
not  they  had  a  CDTI.  They  were  given  more  altitude  and  speed 
changes  than  were  the  pilots  of  the  twin-engine  aircraft,  but  half 
as  many  vectors.  There  were  more  messages  on  the  whole  with  CDTI 


than  without  for  the  pilots  o-f  the  Jets,  whereas  the  reverse  was 
true  -for  the  pilots  of  the  light  aircraft. 

No  differences  in  communications  types  or  frequencies  were  found 
that  could  be  attributed  to  the  fidelity  of  the  simulator.  All  of 
the  differences  found  related  to  aircraft  type  or  eKperimental 
condition.  In  general,  ATC  gave  all  pilots  few  speed  commands  when 
they  were  able  to  see  the  other  aircraft  on  their  displays,  giving 
them  instead  clearances  to  follow  an  aircraft  and  to  maintain 
separation  "visually"  using  the  CDTI.  Position  requests  and  re¬ 
sponses  were  considerably  reduced  by  the  addition  of  CDTIs  and 
VFR  altitude  information.  Altitude  changes,  vectors,  and  clearan¬ 
ces  were  not  affected  by  display  conditions  across  aircraft. 


TABLE  3:  Communications:  Average  number  of  messages  transmitted 
to  and  from  pilots  of  each  aircraft  type  per  group,  per  approach 
by  aircraft  type  and  experimental  condition 


SINGLE  ENGINE  A/C 
(1  pi  lot /group) 

TWIN  ENGINE  A/C 
(3  pilots/group) 

MEDIUM  JET 
(3  pilots/group) 

SOMECDTI 
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2.5 
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27.9 
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25.  3 

33.6 

29.  1 

30.5 

29.6 

23.  1 

26.3 

27.  9 

25.  7 

535 


Pilot  Effort 


S0v«ral  maasuroB  war*  used  to  aBBasa  tha  amount  of  effort  exerted 
by  the  pilots  under  different  experimental  conditions:  number  of 


SP  throttle,  flAPt  And  trim  changes  and  root  mean  squared  aileron 
and  elevator  activity  and  PP  speed,  heading,  and  altitude  changes. 
Each  of  the  eight  effort  measures  were  analyzed  with  a  three-way 
analysis  of  variance  for  repeated  measures.  A  combined  effort 
measure  was  then  created  by  summing  the  measures  transformed  so 
the  mean  and  standard  deviations  of  each  pilots’  distributions  of 


scores  within  each  measure  were  zero  and  one  respectively.  The 
average  effort  scoras  were  computer  for  SPs  and  PPs  separately  due 
to  differences  in  the  types  of  controls  available  to  them.  Other 
actions,  such  as  radio  frequency  change,  map  scale  or  altitude 
range  selection,  and  gear  down  that  occurred  only  once  or  twice 
per  approach  were  examined,  but  were  not  included  in  the  combined 
measure  because  they  contributed  little  to  pilot  workload  and  did 
not  vary  from  trial  to  trial. 


Figure  4:  PSEUDO-PILOT  EFFORT: 

AVERAGE  NUMBER  OF  CONTROL  INPUTS  PER  MINUTE 
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Figure  4  depicts  the  -frequency  of  speed,  heading,  and  altitude 
changes  made  by  PPs  per  minute  of  flight.\  These  inputs  occurred 
partly  as  a  function  of  vectors  and  clearances  given  by  ATC  and 
partly  as  a  function  of  the  pilot’s  own  initiative  to  achieve 
desired  timing,  rates,  positions,  and  separation.  There  were  no 
significant  differences  in  number  or  type  of  control  inputs  for 
any  of  the  experimental  conditions  for  the  raw  frequencies,  nor 
any  significant  interactions.  The  results  were  virtually  identi¬ 
cal  for  the  standardized  summary  measure  of  PP  effort.  These 
results  are  not  surprising  as  the  PPs  were  only  indirectly 
affected  by  the  display  conditions. 

There  was,  however,  a  distinct  difference  in  the  control  strate¬ 
gies  used  for  the  three  aircraft  types  piloted  by  PPs.  Few 

speed  changes  were  made  by  any  of  the  PPs,  however,  twice  as  many 
were  made  by  the  pilot  of  the  jet  (1.0  per  minute  of  flight  on 
the  average)  than  by  the  pilots  of  the  two  general  aviation-type 
aircraft  (0.3  per  minute  of  flight).  Pilots  of  the  single-engine 
aircraft  made  the  greatest  number  of  altitude  changes  <1.0  per 
minute  of  flight),  but  the  fewest  number  of  heading  changes  (0.5 
per  minute  of  flight).  The  pilot  of  the  jet,  on  the  other  hand, 
made  the  fewest  altitude  changes  (0.7  per  minute  of  flight),  and 
the  greatest  number  of  heading  changes  (2.3  oer  minute  of 
flight).  The  many  heading  changes  made  by  jet  GPs  represented 
control  inputs  initiated  by  the  pilot  to  achieve  the  original 
flight  plan,  rather  than  numerous  vectors  or  clearance  changes 
from  ATC. 

Simulator  Pilot  Effort 

One  control  activity  that  was  of  particular  interest  was  the 
frequency  and  type  of  changes  made  by  SPs  in  the  altitude  filter 
that  controlled  the  proportion  of  other  aircraft  within  the  hori¬ 
zontal  map  range  that  were  displayed.  Pilots  selected  the  range 
of  +/-640  m  (2000  ft)  which  had  been  identified  as  the  optimal 
range  in  earlier  studies  (  ref.  1)  60X  of  the  time.  They  added  an 
additional  610  or  1220  m  to  the  range  below  their  own  aircraft 
the  remaining  40^  of  the  time.  This  increase  was  necessitated 
when  they  were  given  a  clearance  to  follow  an  aircraft  that  had 
descended  out  of  range  of  the  narrower  filter  and  had  thus  disap¬ 
peared  from  view.  On  the  average,  SPs  changed  the  relative  alti¬ 
tude  filter  1.5  times  per  approach.  Somewhat  more  changes  were 
made  on  trials  in  which  VFR  aircraft  were  presented  with  altitude 
information  because  these  aircraft,  like  the  IFR  aircraft,  were 
only  displayed  as  long  as  they  were  within  the  selected  range  if 
their  altitude  was  known.  SPs  rarely  increased  the  range  above 
their  own  altitude  because  aircraft  that  were  above  them  were 
typically  behind,  and  were  thus  of  less  interest.  It  is  likely 
that  increasing  the  range  above  would  be  of  use  in  a  departure 
environment,  however  departures  were  not  simulated. 


537 


'.4 


There  were  no  significant  differences  among  the  measures  of  SP 
effort  as  a  function  of  the  two  display  conditions,  although 
there  was  more  aileron  and  throttle  activity  with  a  CDTI  than 
without  (Table  4),  possibly  reflecting  fine  tuning  to  maintain 
separation  assumed  by  SPs  when  given  clearances  to  follow  an 
aircraft  displayed  on  a  CDTI. 

Each  of  the  effort  scores  for  individual  SPs  were  transformed  and 
summed  as  described  previously  to  produce  a  single  measure  of 
performance.  A  three-way  analysis  of  variance  for  repeated  mea¬ 
sures  was  performed  on  these  ratings.  A  significant  interaction 
was  found  between  presence  or  absence  of  VFR  data  tag  information 
and  replications  (F  ■  10.42,  (1,11),  p<.05).  On  earlier  runs, 
fewer  pilot  inputs  occurred  with  a  VFR  tag  than  without,  whereas 
later  in  the  experiment,  more  inputs  were  given.  This  could 
indicate  that  the  pilots  had  learned  how  to  accomplish  the  task 
with  the  different  types  of  information  and  controls  available  to 
them  and  were  using  the  information  in  flying  their  aircraft. 
Overall,  fewer  pilot  inputs  were  recorded  with  VFR  data  tags  than 
without,  whereas  significantly  more  inputs  were  recorded  with  CDTI 
than  without  (F  *  8.72,  (1,11),  p<.05),  reflecting  fine  tuning  by 
SPs  with  traffic  displays. 


TABLE  4:  Individual  measures  of  SP  effort  and  a  combined 

standard! red  measure  of  effort  (Mean  »  0|  St.  Dev,  »  1) 


Measure 
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CDTI 
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1st 

2nd 
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All 

noTAG 

TAG 
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.016 

.017 

.014 

.018 

.015 

.013 

Elevator  (rms) 

.016 

.016 

.016 

.016 

.016 

.016 

Throttle  changes 

18.7 

18.  1 

16.5 

20.3 

20.6 

16.2 

(number ) 

Trim  actuations 

14.2 

13.9 

14.  4 

13.8 

14.0 

13.  9 

(number ) 

Flap  changes 

5.6 

4.8 

5.2 

5.2 

5.8 

4.5 

Combined  standard 

-.009 

O 

O 

• 

1 

-.073 

.078 

.001 

.  005 

effort  score 


Simulator  Pilot  Opinion 


At  the  conclusion  of  each  approach,  SPs  completed  17  rating 
scales.  The  first  14  scales  represented  relevant  dimensions,  such 
as  fatigue  level,  perceived  task  demands,  workload,  etc.  presented 
with  labels  at  the  extremes  (e.g.  lo/hi).  Responses  were  given  on 
a  scale  from  one  to  seven,  one  representing  a  rating  of  "low"  and 
seven  a  rating  of  "high"  on  whatever  dimension  was  being  rated. 
(Table  5>  Fourteen  three-way  analyses  of  variance  for  repeated 
measures  were  performed  to  determine  the  effects  of  replications 
and  the  two  display  conditions.  There  were  no  significant  dif¬ 
ferences  in  responses  related  to  repl icai tons.  Significant  in¬ 
creases  in  rated  task  difficulty  (F  =  9.51,  (1,11),  p<  .05), 
activity  level  (F  =  8.05,  (1,11),  p<.05),  and  required  attention 
(F  =  7.77,  (1,11),  p<.05)  were  found  when  SPs  were  given  traffic 
displays.  This  may  reflect  the  increase  in  pilot  effort  and 


TABLE  5:  Responses  to  bipolar  adjective  scales  by  12  simu¬ 
lator  pilots.  (A  rating  of  1  was  very  low,  7  very  high) 
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communications  with  the  addition  of  CDTI.  A  significant  increase 
in  rated  fatigue  <  F  =  6.34,  (1,11),  p<.05)  and  the  amount  of 
monitoring  required  (F=  6.04,  (1,11),  p<.05)  was  found  with  the 
addition  of  VFR  altitude  information. 

Responses  to  the  14  scales  were  grouped  into  six  categories  on  the 
basis  of  meaning  and  obtained  scores  (Table  5).  The  ratings  were 
then  standardized  so  that  individual  subject’s  distributions  of 
ratings  within  each  scale  had  means  of  zero  and  standard  devia¬ 
tions  of  one.  These  scores  were  then  combined  for  the  six  catego¬ 
ries.  (Figure  5)  Task-related,  operator-related,  and  effort- 
related  scales  increased  significantly  (F  =  6.06,  5.13,  and  7.56 
respectively,  (1,11),  p<.05)  with  the  addition  of  CDTI,  however 
pilots’  estimates  of  their  own  performance  and  workload  were  not 
significantly  affected  by  the  addition  of  a  CDTI.  Frequency  of 
interruptions.  and  overall  workload  were  rated  as  decreasing  non- 
si  gni  f  i  cantl  y  with  the  addition  of  VFR  altitude  information. 


The  last  three  scales  required  the  pilot  to  estimate  the  number  of 
interrupted  tasks,  tht  amount  of  visual,  mental,  and  auditory  free 
time  available  during  the  approach,  and  the  likelihood  of  error. 
Three,  three-way  analyses  of  variance  for  repeated  measures  were 
performed  and  showed  no  significant  differences  among  the  repon¬ 
ses  as  a  function  of  display  condition  or  replications.  All  of 
the  ratings  were  between  3.4  and  3.6  for  the  interruption  scale, 
between  4.2  and  4.4  for  the  rated  amount  of  visual,  auditory  ,  and 
mental  free  time,  and  between  3.7  and  3.9  for  estimated  likelihood 
of  error  out  of  a  total  range  of  1  to  7. 


At  the  conclusion  of  the  experiment,  pilots  completed  a  cebriefing 
similar  to  that  used  in  earlier  studies.  They  reported  that  CDTI 
assisted  them  in  planning  ahead  and  that  they  were  more  aware  of 
the  distance  between  their  own  and  other  aircraft  with  CDTI  than 
during  typical  IFR  flights  with  visual  or  radar  separation.  They 
reported  that  their  workload  was  equivalent  to  that  experienced  in 
a  typical  flight  and  was  not  excessive.  They  considered  the 
simulation  to  be  adequately  realistic  for  the  type  of  research 
conducted,  and  that  the  types  of  tasks  pt-r  formed  in  the  simula¬ 
tor  would  be  about  as  difficult  to  perform  in  the  aircraft  they 
were  accustomed  to  flying.  The  pilots  responded  that  they  would  be 
willing  to  accept  aircraft-following  types  of  clearances,  as  re¬ 
ceived  in  this  simulation,  and  to  take  responsibility  for  maintai¬ 
ning  separation  in  line  operations  if  the  lead  aircraft  was  in 
sight  on  a  CDTI. 


DISCUSSION 

Many  of  the  most  interesting  results  of  this  simulation  related 
to  practical  consi derat i ons  associated  with  conducting  research 
with  multiple  piloted  simulators.  A  major  concern  in  earlier 
studies  (refs.  4,  8),  was  that  ATC  control  strategies  differed  as 
a  function  of  the  level  of  realism  of  the  simulator.  This  ques¬ 
tion  could  not  be  resolved,  however,  because  aircraft  type 


(gsneral  aviation  or  transport)  covaried  with  the  the  fidelity  of 
the  simulators.  In  the  current  study,  different  aircraft  types 
were  simulated  with  full  pilot  control  (SP)  or  with  more  limited 
control  (PP) .  The  results  indicated  that  control  differences 
found  in  earlier  studies  occurred  as  a  consequence  of  the  type  of 
aircraft  simulated  rather  than  the  realism  of  the  simulator,  as 
long  as  the  simulator  was  manned  by  a  qualified  pilot  and 
communications  with  ATC  were  conducted  realistically.  ATC 
expedited  the  flow  of  transport  traffic  into  the  simulated 
airport  in  a  manner  representative  of  current  operations,  using 
speed  and  altitude  control  and  giving  vectors  to  single-  and  twin 
engine  general -aviation-type  aircraft  to  achieve  desired 
sequencing  and  separation.  Transport-type  aircraft  were  rarely 
vectored  off  the  route  except  to  expedite  their  approach.  The 
primary  method  of  control  used  for  them  was  the  issuance  of  speed 
changes  and  clearances  to  fallow  or  maintain  separation  behind 
aircraft  in  view  on  a  CDTI. 

This  simulation  provides  further  information  about  the  importance 
of  providing  a  realistic  environment  when  analyzing  simulator 
pilots'  interactions  with  various  CDTI  configurations  and  the 
impact  of  such  conf igurai tons  on  the  ATC  system.  The  PPs  and 
controllers  were  included  in  this  simulation  to  increase  its 
realism  for  the  SPs  by  providing  communci ati ons,  strategies, 
errors,  and  decisions  made  by  human  operators.  It  appears  that 
relatively  simple  displays,  controls  and  aircraft  models  can  be 
used  to  provide  this  dimension  as  long  as  the  aircraft  thus  simu¬ 
lated  move  realistically  on  whatever  display  medium  is  used  and 
are  controlled  by  qualified  pilots  who  sound  authentic  and  react 
appropriately  to  ATC.  The  use  of  qualified  controllers  is  another 
relatively  simple  but  important  way  to  place  a  simulation  in  an 
appropriate  context  for  simulator  pilots  and  to  thus  increase  the 
validity  of  results. 

As  was  found  in  the  earlier  study  (ref.  4),  no  pilot  ever  took 
unilateral  action  as  a  consequence  of  information  observed  or 
inferred  from  the  CDTI.  SPs  were  willing  to  accept  closer  sepa¬ 
ration  with  a  CDTI,  but  not  to  the  point  that  the  safety  of  flight 
was  in  jeopardy.  They  complied  with  ATC  clearances  to  follow  a 
lead  aircraft  or  to  maintain  separation  from  an  aircraft  that  was 
displayed  on  the  CDTI.  Because  the  CDTI  provided  more  infor¬ 
mation,  the  possibiTity  of  pilot  participation  in  some  aspects  of 
planning  and  achievement  of  control  strategies  developed  by  ATC 
was  possible.  Communications,  particularly  those  related  to  traf¬ 
fic,  increased  with  CDTI,  and  high  frequency,  low  amplitude  con¬ 
trol  activity  to  accomplish  fine  tuning  increased.  The  addition 
of  CDTI  was  also  associated  with  an  increase  in  the  pilots' 
subjective  ratings  of  task  difficulty  and  activity,  but  not  their 
perception  of  workload  or  the  quality  of  their  own  performance. 
Even  though  the  pilots  experienced  increased  task  demands  and 
effort  with  CDTI,  they  rated  their  overall  workload  in  this  simu¬ 
lation  as  approximately  the  same  as  in  a  typical  flight  in 
response  to  questions  on  the  debriefing.  Furthermore,  they  indi— 
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cated  that  the  addition  o-f  CDTI  into  line  operations  would  ulti¬ 
mately  result  in  -fewer  communications  with  ATC.  They  would  be 
willing  to  accept  ai rcraf t— f ol 1 owi ng  types  of  clearancas  with  a 
CDTI  and  to  take  responsibility  for  spacing  between  their  own  and 
a  lead  aircraft  in  sighi:  on  a  traffic  display  "most  of  the  time". 


The  results  of  this  simulation  provide  additional  verification 
of  the  opinions  expressed  by  pilots  in  the  earlier  studies  (refs. 
1,  2)  about  content,  format,  and  symbology  for  a  CDTI  after  they 
had  had  a  chance  to  experience  many  of  the  different  features 
while  conducting  simulated  approaches.  Further  research  is 
clearly  required,  however,  to  address  the  remaining  conceptual 
and  practical  issues.  These  issues  include:  (1)  the  impact  of 
CDTI  on  procedures  and  regulations  under  different  mixes  of  CDTI- 
equipped  aircraft  in  controlled  and  uncontrolled  airspace*  (2) 
the  relative  quality  of  information  obtained,  retained,  and  used 
from  various  CDTI  configurations;  (3)  pilot  assurance,  situation 
awareness,  and  ability  to  plan  ahead  with  CDTI;  and  (4) 
practical  consi der at i ons  such  as  the  effect  of  CDTI  on  fuel 
economy,  airport  throuyhput,  and  system  safety.  Answers  to  these 
and  other  questions  are  prerequisites  of  a  decision  to  provide 
visual  displays  of  traffic  information  in  cockpits. 
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ABSTRACT 

This  study  examines  the  air  traffic  control  of  air  carrier 
and  general  aviation  simulated  aircraft  with  and  without  a 
cockpit  display  of  traffic  information  (CDTI).  Air  traffic 
controllers  provided  spacing  and  sequencing  for  air  carrier 
type  simulators  flown  by  airline  pilots  and  small  twin 
engine/single  engine  lower-fidelity  simulators  flown  by  gen¬ 
eral  aviation  pilots  on  an  approach  to  landing.  Some  of 
these  aircraft  had  CDTI,  a  graphic  representation  of  the 
position  of  other  aircraft  relative  to  his/her  aircraft  and 
the  navigational  aids. 

Differences  in  the  air  traffic  control  were  found  due 
to  aircraft  type  and  the  presence  of  a  CDTI.  There  was  no 
difference  due  to  CDTI  in  aircraft  separation  violations. 
Two  air  carrier  aircraft  were  within  one  nautical  mile 

1 . eral  separation  and  950  feet  vertically  for  a  longer 

period  of  time  than  two  general  aviation  (GA)  aircraft  or  an 
air  ca-rier  and  GA  aircraft.  Two  GA  aircraft  were  within 
one  mile  longer  than  an  air  carrier  and  a  GA  aircraft. 

The  variance  of  intercrossing  times  at  the  middle 
marker  between  an  aircraft  and  the  previous  aircraft  was 
greater  for  aircraft  with  CDTI  and  for  air  carrier  aircraft. 

The  numoer  and  type  of  controller/pilot  communications 
were  different  for  the  conditions  of  simulator  type  and 
presence  of  CDTI.  Of  those  communication  types  showing 
differences  in  frequency  due  to  the  presence  of  a  CDTI,  all 
except  heading  changes  occured  more  often  to  and  from  an 
aircraft  with  a  CDTI.  For  example,  the  controller  gave  more 
traffic  advisories  and  had  mors  questions  for  an  aircraft 
with  a  CDTI.  Those  aircraft  with  CDTI  had  more  communica¬ 
tions  of  all  types  than  those  without  CDTI.  The  airline  air¬ 
craft  in  general,  had  more  communications  but  the  smaller 
aircraft  had  more  communications  concerning  heading  changes. 

Air  traffic  control  of  the  aircraft  in  this  simulation 
showed  similar  characteristics  to  the  current  aviation  sys¬ 
tem.  For  example,  the  air  carrier  aircraft  were  given  speed 
and  altitude  changes  while  the  GA  aircraft  were  given 

*  Supported  by  NASA  Grant  NSG  2156  to  Tufts  University. 
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heading  changes.  The  CDTI  effected  communications  between 
the  controller  and  the  pilots  reflecting  the  use  of  the  CDTI 
information  for  aircraft  separation. 


INTRODUCTION 


cockpit  display  of  traffic  information  is  a  display 
shoWing  the  pilot  the  position  of  other  aircraft  relative  to 
his  or  her  aircraft  position.  The  display  may  include  other 
information  such  as,  ground  speed  and  altitude  of  the  other 
aircraft  and  navigational  information.  This  and  other  stu¬ 
dies  explore  the  effects  on  safe  and  efficient  air  traffic 
flow  associated  with  the  use  of  a  CDTI. 


When  the  CDTI  becomes  available,  it  is  likely  that  air 
carrier  operators  will  be  among  the  first  to  make  use  of 
this  traffic  information.  General  aviation  (GA)  aircraft 
will  typically  be  much  less  likely  to  invest  in  this  type  of 
display.  This  creates  a  variety  of  capabilities  within  the 
air  traffic  control  system.  In  this  simulation  there  was  a 
combination  of  aircraft  types:  general  aviation  single 
engine  aircraft  flown  by  GA  pilots  and  air  carrier  aircraft 
flown  by  line  pilots  with  a  mix  of  CDTI  capabilities.  This 
study  examines  the  effects  of  the  aircraft  type  and  the  use 
of  the  cockpit  display  of  traffic  information  on  air  traffic 
control.  V 


METHODOLOGY 


Subjects 

There  were  three  groups  of  subjects  from  the  San  Jose 
area.  Each  of  the  groups  included  one  controller,  three 
airline  and  four  general  aviation  pilots.  The  subjects  per¬ 
forming  the  air  traffic  control  were  former  air  traffic  con¬ 
trollers  from  approach,  tower,  and  center  facilities.  The 
nine  line  pilots  were  currently  employed  by  major  U.S.  air 
carriers.  The  twelve  general  aviation,  instrument-rated 
pilots  had  a  variety  of  experience  levels. 


Equipment 

The  study  was  conducted  in  the  Multicockpit  Facility  at 
NASA  Ames  Research  Center.  The  facility  had  seven  aircraft 
under  air  traffic  control  (ATC) .  There  were  three  single- 
pilot  air  carrier  simulators  based  on  the  Boeing  727  with 
simplified  flight,  navigation,  and  engine  instruments  and 
controls.  The  four  general  aviation  L.mulatcrs  were  modeled 
on  the  Cessna  310  and  172.  The  simulators  consisted  of  a 
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®  sliding  potentiometer 
throttle.  The  GA  pilots  had  digital  information  of 
their  current  and  commanded  speed,  heading  and  altitude.  An 

transmissions  between  the 

pilots  and  the  controller. 


*.K«  cockpit  displays  of  traffic  information  used  in 
this  study  were  presented  on  a  cathode  ray  tube.  The 
controller  s  station  had  a  display  similar  to  that  found  at 
an  approacn/departure  facility  (Figure  1) . 
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Figure  1.  ATC  and  GA  display  of 
information . 


traffic 


nav igational 


The  air  traffic  controller  had  a  north-up  display  of  all 

®  range.  The  position  of 

®  triangle.  The  aircraft  moved 

in  relative  to  the  navigational  information 

in  tne  san  Jose  area. 

‘^';'o-segment  flight  path  predictor  line  in 
tront  of  each  aircraft  symbol  which  showed  where  the  air- 
craft  would  be  in  60  seconds,  if  the  speed,  heading,  and 
launch  L  '^®I®  'maintained  for  that  period  of  time.  The 

rafio^h  5  varied  with  ground  speed  since  it 

reflected  the  distance  traveled  in  60  seconds.  There  were 
history  dots  behind  the  aircraft  showing  the  previous  posi¬ 
tions  at  four  second  intervals  for  the  last  thirty  two 

identifi  aircraft  had  a  data  tag  showing  the  aircraft 

identification,  and  the  altitude  (in  hundreds  of  feet)  on 


the  first  line,  and  the  ground  speed  (in  knots)  and  an  arrow 
which  indicated  whether  the  aircraft  was  climbing  or  des¬ 
cending  (vertical  velocity  greater  than  100  f eet/minute)  on 
the  second  line. 

This  display  was  identical  to  the  display  shared  by  the 
four  general  aviation  pilots  and  was  updated  every  four 
seconds.  Since  the  GA  pilots  required  the  CDTI  information 
to  make  their  flight,  the  conditions  of  no  CDTI  consisted  of 
them  ignoring  the  other  traffic  on  the  display.  They  did  so 
very  effectively. 

The  display  for  the  air  carrier  simulators  was  always 
heading  up  (Figure  2) .  The  ownship  symbol  remained  station¬ 
ary  on  the  display  horizontally  centered  and  vertically  one 
third  from  the  bottom.  The  airway  appeared  to  pass  under 
the  ownship  symbol. 


Figure  2.  Air  Carrier  CDTI  showing  ownship  and  map  informa¬ 
tion. 

The  map  scale  was  pilot-selectable  to  2,  4,  8,  16,  32  and  64 
nautical  miles  (nm) .  It  was  also  possible  to  select  an 
automatic  scale  that  varied  from  64  to  2  miles  with  the 
aircraft's  altitude.  All  aircraft  •<■/-  2000  feet  in  altitude 
from  the  pilot's  aircraft  were  shown,  in  addition  the  pilots 
were  able  to  selectively  Include  aircraft  +/-  4000  and  6000 
feet . 

The  traffic  on  the  air  carrier  simulator  CDTI ' s  was 
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shown  by  a  hexagon  it  the  aircraft  was  within  500  feet  of 
ownship.  Only  the  top  half  of  the  hexagon  showed  if  the 
aircraft  was  more  than  500  feet  above  and  the  bottom  if  more 
than  500  feet  below.  For  the  no  CDTI  condition,  the  display 
showed  the  position  of  ownship  only  relative  to  the  naviga¬ 
tional  map. 

The  flight  and  engine  Instrument  Information  was 
updated  every  one  tenth  of  a  second.  The  ownship  informa¬ 
tion  on  the  CDTI  including  the  navigational  information,  was 
updated  five  times  a  second.  The  information  on  the  other 
aircraft  was  only  updated  every  four  seconds.  No  radar 
errors  were  simulated  in  this  study. 


Procedure 

The  subjects  were  paid  for  the  two  days  they  partici¬ 
pated.  Initially,  the  controller  and  pilots  were  briefed  on 
the  experiment  and  the  simulation.  The  controller's  task  was 
to  provide  spacing  and  sequencing  for  all  seven  aircraft  on 
the  approach  and  l;.nding.  During  the  first  few  minutes  of  a 
run,  all  the  aircraft  became  airborne  (randomly  placed)  at 
the  navigational  fixes  south  of  the  San  Jose  Airport.  Prom 
this  position  the  pilots  flew  their  simulators  under  ATC 
control  according  to  the  published  ILS  approach  procedures 
and  landed  at  San  Jose  Airport.  After  an  aircraft  landed  it 
was  repositioned  (with  equal  probability)  at  one  of  the 
three  outer  most  positions,  35  miles  from  the  airport.  All 
the  aircrafc  remained  on  an  instrument  flight  plan  with  nor¬ 
mal  radio  communications  carried  out  with  the  controller. 
The  airline  pilots  flew  the  simulators  manually.  The  GA 
pilots  provided  autopilot  inputs  to  their  aircraft  until  the 
outer  marker  where  an  autopilot  took  control  of  their  air¬ 
craft  for  the  landing. 

Ten  minutes  after  the  run  began,  the  airport  was  closed 
and  the  aircraft  were  put  into  holding  patterns  until  the 
airport  reopened  five  minutes  later.  Each  run  lasted  thirty 
minutes.  There  was  a  25  knot  wind  above  2000  feet  decreas¬ 
ing  linearly  to  15  knots  on  the  ground.  No  turbulence  was 
simulated . 

Training  -  The  first  three  flights  were  flown  without  a 
CDTI  to  Familiarize  the  pilots  with  the  simulators.  The 
forth  and  fifth  flights  were  made  with  the  CDTI  available 
but  pilots  were  not  required  to  use  the  information  for 
separation.  For  the  sixth  and  seventh  flights,  only  two  air 
carrier  aircraft  had  CDTI. 

Experimental  Flights  -  There  were  six  experimental 
f 1 ights .  The  First  two  were  made  with  no  CDTI  (i.e. 
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navigational  information  only)  for  the  air  carrier  simula¬ 
tors.  The  GA  pilots  had  traffic  information  but  were  asked 
to  ignore  the  other  aircraft  and  follow  only  the  ATC  com¬ 
mands  for  heading,  speed,  and  altitude.  For  the  next  two 
flights,  all  seven  aircraft  had  a  CDTI.  The  final  two 
flights  were  made  with  only  two  air  carrier  simulators  hav¬ 
ing  CDTI.  Therefore,  the  number  of  CDTI  aircraft  varied 
from  zero  to  seven.  At  the  end  of  each  flight,  time  was 
taken  for  discussion  and  questions. 


RESULTS 


There  are  several  areas  of  interest  when  exploring  the 
air  traffic  control  of  aircraft  with  a  CDTI.  The  foremost 
question  is  safety.  Does  the  implementation  of  the  CDTI 
increase  or  decrease  the  overall  safety  of  air  travel?  More 
specifically,  is  the  separation  of  aircraft  as  good  or 
better  when  the  aircraft  involved  have  a  traffic  display? 
Among  other  concerns  is  efficiency.  If  the  aircraft  are  too 
far  apart  in  landing,  fewer  aircraft  can  land  in  the  same 
amount  of  time,  therefore,  there  is  a  decrease  in  the  capa¬ 
city  of  the  air  traffic  system.  Another  good  indication  of 
the  characteristics  of  the  ATC  system  Is  the  communication 
between  the  controller  and  the  pilots.  The  above  measures 
were  examined  by  1)  presence  of  CDTI,  2)  type  of  simulator, 
and  3)  number  of  CDTI-equlpped  aircraft  being  controlled. 

Aircraft  spacing 

There  were  two  variables  of  aircraft  spacing  used  to 
evaluate  the  air  traffic  control  system:  aircraft  spacing 
violations  and  aircraft  intercrossing  times  at  the  outer  and 
middle  marker  on  final  approach. 

Aircraft  spacing  deviations  were  measured  in  seconds 
during  which  two  aircraft  were  too  close,  i.e.,  within  1,  2, 
and  2.5  nautical  miles  laterally  with  vertical  separation  of 
less  than  950  feet.  There  were  no  effects  on  aircraft  spac¬ 
ing  violations  due  to  the  presence  or  absence  of  a  CDTI  in 
the  simulator.  No  effects  were  found  due  to  the  number  of 
aircraft  with  CDTI.  There  were  differences  in  the  separa¬ 
tion  errors  by  simulator  type.  Two  air  carrier  simulators 
were  within  one  mile  separation  for  a  longer  duration  than 
an  air  carrier  and  GA  aircraft  (t»-4.93,  df«18,  p<.001)  or 
two  GA  aircraft  (t-3.46,  df«18,  p<.01).  GA  aircraft  were  in 
violation  at  1  nm  separation  for  a  longer  time  than  an  air 
carrier  and  GA  aircraft  (t»2.20,  df=18,  p<.05).  At  2  nm 
there  were  no  differences  due  to  simulator  type.  Two  GA 
aiicraft  were  within  2.5  nm  longer  than  an  airline  and  GA 
aircraft  (t»2.02,  df*18,  p<.05). 
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The  number  o£  seconds  between  an  aircraft  and  the  pre¬ 
vious  aircraft  when  crossing  the  outer  or  middle  marker  was 
not  significant  for  any  condition.  However,  the  variance 
between  the  intercrossing  tiroes  was  significantly  larger  for 
aircraft  with  CDTI  than  aircraft  without  (Levene  F=9.29, 
df=158,  p<.01).  Air  carrier  simulators  had  greater  variance 
of  intercrossing  tiroes  with  the  aircraft  ahead  of  them  at 
the  middle  marker  than  GA  aircraft  (F=6.49,  df=158,  p<.01). 

Communications 

The  communications  between  the  controllers  and  pilots 
were  categorized.  An  aircraft  with  CDTI  had  more  total  com¬ 
munications  to  and  from  ATC  than  an  aircraft  without  a  CDTI 
(Mann-Whi tney  2^4.61,  dfa2518,  p<.001).  ATC  gave  more 
clearances  (z=-2.51,  df*164,  p<.Cl),  traffic  advisories 
(z*»-8.43,  df=‘164,  p<.001),  clearances  to  follow  another  air¬ 
craft  (z>-10.84,  dfsl64,  p<.001)  and  had  more  questions 
(z=-2.63,  df=164,  p<.05)  for  aircraft  with  CDTI  than  air¬ 
craft  without  CDII .  The  controller  gave  more  heading 
changes  to  aircraft  without  CDTI  (2=-2.51,  df»164,  p<.05). 
Pilots  asked  more  questions  (z=-2.54,  dfsl64,  p<.05)  and 
made  more  acknowledgments  (Z--6.85,  df=l64,  p<.001)  when 
they  had  a  CDTI  in  their  simulators. 

The  total  number  of  communications  went  up  proportion¬ 
ally  with  the  number  of  CDTI-equlpped  aircraft  (7,2  or  0)  on 
an  experimental  run  (F-4.12,  df»1887,  p<,05).  ATC  gave  more 
traffic  advisories  (Pal6.97,  df«123,  p<.001)  and  clearances 
to  follow  another  aircraft  (F*47.15,  df=»123,  p<.001)  as  the 
number  of  CDTI-equipped  aircraft  increased.  Pilot  communi¬ 
cations  were  also  greater  by  the  number  of  CDTI-equipped 
aircraft.  Pilots  asked  more  questions  (Fa3.65,  dfsl23, 
p<.05)  and  made  more  acknowledgments  (F»12.88,  df»123, 
p<  .001)  . 

Air  traffic  control  had  more  communications,  of  the 
following  type,  with  the  airline  simulators:  clearances 
(Mann-V/hitney  z»-7.45,  df»124,  p<.001),  speed  changes  (z«- 
6.85,  df*124,  p<.001),  altitude  changes  {z=-4.28,  df»124, 
p<.001),  questions  (z»-4.17,  dfal24,  p<.001),  traffic 
advisories  (z*-3.87,  df=124,  p<.001),  and  clearances  to  fol¬ 
low  another  aircraft  (z*-3.20,  df»124,  p<.01).  The  con¬ 
troller  gave  more  heading  changes  to  the  GA  aircraft  (z=- 
3.96,  df«124,  p<  .001).  The  pilots  of  air  carrier  simula¬ 
tors  had  more  acknowledgments  (z«-4.41,  dfsl24,  p<.001),  and 
readbacks  (z»-4.36,  df=124,  p<.001).  There  were  more  total 
communications  by  or  with  air  carrier  simulators  (z»-5.86, 
df>1888,  p<.001).  Communication  categories  showing  no 
effect  were  position  reports  and  readbacks. 


None  of  the  dependent  measures  showed  learning  effects 
across  trials. 
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DISCUSSION 


The  findings  of  this  study  are  not  surprising.  Basi¬ 
cally  the  air  traffic  controllers  handled  the  simulators  as 
they  would  real  aircraft,  i.e.  the  controllers  gave  altitude 
and  speed  changes  to  the  air  carrier  aircraft  and  heading 
changes  to  the  general  aviation  aircraft. 

The  presence  of  a  CDTI  yielded  no  effect  on  separation 
violations  which  demonstrates  no  effect  on  safety  due  to  the 
CDTI  in  the  aircraft.  Theic  is  larger  variance  in  inter¬ 
crossing  times  at  the  middle  marker  therefore,  there  is  less 
consistency  with  CDTI-equipped  aircraft.  This  may  be  toler¬ 
able  since  there  is  more  information  in  the  system,  i.e. 
CDTI-equipped  aircraft  have  redundant  ATC  traffic  informa¬ 
tion  . 


The  differences  in  the  types  of  communications  due  to 
the  presence  of  a  CDTI  and  the  number  of  CDTI-equipped  air¬ 
craft  suggest  the  controllers  are  using  the  Information  in 
the  traffic  display  to  separate  and  sequence  the  aircraft. 
The  clearances  to  follow  another  aircraft,  for  example, 
require  the  pilot  to  maintain  visual  contact  with  the  air¬ 
craft  and  provide  separation.  These  clearances  were  given 
on  an  average  of  1.35  times  per  CDTI-equipped  aircraft  per 
flight.  When  an  aircraft  did  not  have  a  CDTI,  there  was  not 
sufHclent  information  to  assume  responsibility  for  separa¬ 
tion  from  the  preceding  aircraft.  As  both  controllers  and 
pilots  become  more  familiar  with  the  CDTI,  there  will  likely 
be  additional  differences  in  the  communications  which  demon¬ 
strate  other  uses  of  the  cockpit  display  of  traffic  informa¬ 
tion. 
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